-- Logs begin at Mon 2022-07-11 13:33:20 UTC, end at Mon 2022-07-11 14:33:15 UTC. -- Jul 11 13:58:24.832624 dv-cinder-819149-10-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 11 13:58:24.840470 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 11 13:58:24 2022] *** Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: nodename: dv-cinder-819149-10-iscsi Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: machine: x86_64 Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: clock source: unix Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: pcre jit disabled Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: detected number of CPU cores: 4 Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: current working directory: / Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: detected binary path: /usr/bin/uwsgi-core Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: your processes number limit is 47680 Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: your memory page size is 4096 bytes Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: detected max file descriptor number: 2048 Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: lock engine: pthread robust mutexes Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: thunder lock: enabled Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 11 13:58:24.844857 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 11 13:58:24.888595 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: Python main interpreter initialized at 0x55faf56019c0 Jul 11 13:58:24.888595 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: python threads support enabled Jul 11 13:58:24.888595 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: your server socket listen backlog is limited to 100 connections Jul 11 13:58:24.888595 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: your mercy for graceful operations on workers is 90 seconds Jul 11 13:58:24.888980 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: mapped 403077 bytes (393 KB) for 2 cores Jul 11 13:58:24.889055 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: *** Operational MODE: preforking *** Jul 11 13:58:24.889310 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: *** uWSGI is running in multiple interpreter mode *** Jul 11 13:58:24.889310 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: spawned uWSGI master process (pid: 80381) Jul 11 13:58:24.889527 dv-cinder-819149-10-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 11 13:58:24.893942 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: spawned uWSGI worker 1 (pid: 80387, cores: 1) Jul 11 13:58:24.893942 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: spawned uWSGI worker 2 (pid: 80388, cores: 1) Jul 11 13:58:24.893942 dv-cinder-819149-10-iscsi devstack@keystone.service[80381]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 11 13:58:30.475650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:58:30.475650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: from cryptography.utils import int_from_bytes Jul 11 13:58:30.476415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:58:30.476415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: from cryptography.utils import int_from_bytes Jul 11 13:58:30.477139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:58:30.477139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: from cryptography.utils import int_from_bytes Jul 11 13:58:30.477590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 11 13:58:30.477590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: from cryptography.utils import int_from_bytes Jul 11 13:58:30.529331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 13:58:30.529545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 13:58:30.529742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] command line args: [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 13:58:30.530018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 13:58:30.530220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ================================================================================ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 13:58:30.530488 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] admin_token = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.530741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config_dir = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.530828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 11 13:58:30.530935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.531023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 11 13:58:30.531123 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config_source = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.531212 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] command line args: [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 11 13:58:30.531291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] debug = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.531491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 11 13:58:30.531575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.531754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ================================================================================ {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 11 13:58:30.531886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.531965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] admin_token = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.532031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.532165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] config_dir = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.532284 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.532367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.532533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] config_source = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.532619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.532722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] debug = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.532805 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.532933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.533047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_config_append = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.533115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.533178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.533298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_dir = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.533379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.533450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.533591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.533675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.533847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.533935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.534087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.534227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.534327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_config_append = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.534448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.534571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.534652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.534728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_dir = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.534811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.534893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_file = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.535025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.535109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.535278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.535361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.535515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.535603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.535755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.535834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.535960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.536036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.536164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.536247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.536341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.536465 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.536593 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.536716 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.536834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.536998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.537082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.537298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.537494 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.537584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.537695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] publish_errors = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.537815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.537933 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.538041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.538177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.538341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.538475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.538603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.538844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.538928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.539030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] publish_errors = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.539106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] standard_threads = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.539268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.539367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.539505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.539584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.539687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.539770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.539892 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_journal = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.539969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.540039 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_json = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.540165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.540243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_stderr = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.540386 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_syslog = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.540510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] standard_threads = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.540590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.540661 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.540852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.540936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.541020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.541097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.541201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] use_journal = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.541383 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.541469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] use_json = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.541571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] use_stderr = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.541656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.541871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.541948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] use_syslog = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.542115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.542224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 11 13:58:30.542399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.542486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.542643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.542720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.542897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.542974 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.543141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.543229 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.543393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.543476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.543633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.543710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.543881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.543965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.544121 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.544197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.544370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.544447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.544619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.544712 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.544858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.544936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.545099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.545175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.545353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.545506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.545588 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.545669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.545828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.545907 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.546085 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.546190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.546373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.546485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.546635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.546750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.546896 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.547009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.547149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.547284 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.547392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.547477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.547653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.547740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.547923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.548015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.548180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.548258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.548429 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.548513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.548663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.548740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.548896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.548972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.549129 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.549213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.549371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.549455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.549619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.549695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.549870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.549948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.550104 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.550203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.550364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.550443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.550603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.550681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.550840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.550920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.551077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.551154 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.551298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.551373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.551540 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.551618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.551779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.551856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.552029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.552114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.552265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.552348 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.552547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.552634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.552746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.552825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.552988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.553236 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.553494 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.553839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.553983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.554257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.554535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.554610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.554782 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.554882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.555026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.555106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.555263 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.555345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.555524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.555644 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.555765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.555844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.556010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.556102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.556247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.556333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.556518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.556599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.556760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.556838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.557043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.557145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.557297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.557481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.557579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.557785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.557864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.558028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.558106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.558306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.558425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.558533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.558620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.558776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.558896 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.559017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.559124 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.559242 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.559358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.559487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.559575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.559730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.559851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.559971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.560054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.560218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.560299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.560461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.560551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.560699 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.560777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.560939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.561019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.561179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.561260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.561418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.561497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.561683 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.561763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.561926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.562005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.562177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.562257 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.562423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.562501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.562664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.562744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.562906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.562985 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.563146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.563224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.563384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.563464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.563620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.563700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.563856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.563935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.564080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.564154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.564326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.564411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.564558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.564640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.564804 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.564893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.565044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.565123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.565295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.565372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.565534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.565611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.565782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.565860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.566027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.566107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.566295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.566376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.566553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.external = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.566639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.566773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.566852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.567012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.567091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.567249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.567329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.567492 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.567570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.password = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.567729 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.567817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.token = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.567971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.568059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.568210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.568292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.568460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.568546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.568698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.568787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.568952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.569033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.569203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.569282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.569440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.569529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.569675 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.external = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.569755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.569913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.569992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.570230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.570328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.570439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.570557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.570681 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.570768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.password = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.570916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] auth.token = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.571003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.571156 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.571241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.571395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.571473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.571650 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.571741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.571888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.571969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.572142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.572222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.572397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.573008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.573189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.573271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.573465 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.573546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.573732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.573819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.573989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.574069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.574266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.574349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.574512 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.574604 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.574764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.574853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.575007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.575087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.575249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.575336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.575503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.575583 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.575745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.575825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.576000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.576088 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.576239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.576318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.576498 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.576649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.576727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.576809 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.576984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.577065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.577223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.577303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.577476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.577565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.577722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.577802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.577959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.578038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.578220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.578314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.578466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.578545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.578699 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.578779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.578941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.579097 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.579195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.579276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.579435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.579514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.579674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.579754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.579909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.579989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.580144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.580225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.580393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.580480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.580643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.580724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.580893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.580972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.581134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.581214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.581377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.581456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.581633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.581714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.581870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.581955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.582115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.582213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.582377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.582456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.582623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.582710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.582861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.582941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.583096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.583177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.583367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.583498 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.583573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.583634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.583827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.583937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.584063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.584147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.584324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.584404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.584580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.584666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.584820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.584901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.585072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.585158 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.585312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.585389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.585548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.585626 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.585787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.585863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.586019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.586095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.586280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.586360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.586521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.586598 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.586764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.586840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.587003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.587082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.587243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.587320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.587496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.587574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.587746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.587831 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.587977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.588054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.588786 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.588879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.589134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.589214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.589378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.589595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.589683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.589842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.589930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.590083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.590191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.590352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.590430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.590589 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.590679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.590831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.590909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.591074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.591152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.591321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.591407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.591574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.591651 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.591811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.591889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.592050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.592136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.592288 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.592376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.592524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.592603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.592767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.592848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.593006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.593084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.593247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.593325 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.593481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.593559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.593728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.593808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.593977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.594056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.594240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.594322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.594493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.594571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.594743 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.594820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.594977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.595056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.595221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.595299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.595457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.595535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.595737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.595828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.595943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.596022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.596183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.596262 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.596418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.596496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.596672 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.596749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.596922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.597000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.597171 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.597250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.597406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.597483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.597655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.597734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.597887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.597965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.598124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.598227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.598394 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.598472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.598637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.598717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.598880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.598957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.599119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.599207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.599360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.599440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.599605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.599690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.599852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.599951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.600100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.600196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.600336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.600414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.600591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.600678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.600833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.600913 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.601075 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.601154 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.601317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.601394 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.601556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.601635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.601800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.601878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.602069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.602190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.602301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.602383 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.602535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.602613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.602790 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.602868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.603041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.603121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.603282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.603360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.603532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.603610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.603864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.603950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.604144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.604280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.604401 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.604598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.604684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.604855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.604934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.605095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.605173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] role.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.605350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] role.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.605436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.605588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.605667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.605840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.605917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.606093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.606202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.606373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.606542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.606625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.606784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.606874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.607045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.607124 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.607298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.607377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.607551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.607638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.607807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.607886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.608047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.608141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.608300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.608439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.608553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.608632 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.608796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.608875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.609032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.609255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.609335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.609502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.609581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.609761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.609840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.610018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.610096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.610294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.610375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.610538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.610617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.610781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.610862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.611021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.611099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.611261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.611347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.611503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.611581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.611753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.611830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.611991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.612076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.612225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.612303 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.612487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.612566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.612725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.612814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.612973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.613052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.613221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.613298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.613470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.613555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.613712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.613789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.613952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.614019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.614214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.614340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.614467 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.614553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.614722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.614808 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.614958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.615047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.615205 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.615286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.615490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.615569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.615745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.615834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.615990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.616082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.616240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.616321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.616480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.616559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.616722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.616809 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.616964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.617045 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.617205 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.617285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.617444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.617533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.617684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.617764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.617931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.618012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.618188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.618283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.618440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.618521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.connection = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.618680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.618770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.618933 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.619015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.619175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.619258 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.619471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.619559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.619792 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.619873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.620050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.620132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.620296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.620377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.620538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 13:58:30.620619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.620787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.621030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.621279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.621522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.621776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.622018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.622291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.622529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.622774 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.623015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 11 13:58:30.623192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 11 13:58:30.652905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.653145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.653377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.653465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.653674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.653909 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.662209 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.663199 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.690412 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.690646 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.691220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.691459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.832354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.834045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.882792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.882986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.883087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.883201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.950534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.950762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.950990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.951215 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.951437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.951656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.952501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.952738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.952968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.953194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.953441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.953676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.976750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.976984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.977194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.977336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.977419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.977494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.977635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.977731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.977858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.977942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.978077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.978189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.978323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.978544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.989463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:30.989573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.002752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.002989 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.003093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.003217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.003301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.003441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.003525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.003663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.003748 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.003880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.003963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.004099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.004183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.004334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80387) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 11 13:58:31.023307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.023519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 13:58:31.023607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.023827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 13:58:31.023931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.024059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 13:58:31.024169 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.024336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.024420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 11 13:58:31.024601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.024693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.024863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.024946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.025121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.025203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.025657 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.036206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.036488 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.036627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.036759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.036909 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.037043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.037181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.037465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.045477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.045737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.048824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.049106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.049190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.049392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.049475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.049680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.049766 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.049970 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.050057 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.050260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.050533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.050616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.050808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.050890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.051080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.051170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.051349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.051430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.051618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.051699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.051888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.079969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.080397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.081611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.081897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.082047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.082353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.087308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.087547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.087683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.087950 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.088083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.088280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.095379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.095665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.095797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.096086 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.100250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.100541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.100707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.100839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.100980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.101109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.101270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.101412 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.101540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.101697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.101902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.102032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.102182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.102311 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.102473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.102746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.121757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.122035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.122485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.122770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.126919 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.127571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.130629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.130927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.131326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.131626 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.136799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.137451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.140504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.141266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.144479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.144776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.145071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.145245 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.145378 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.145547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.145690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.145831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.145959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.146112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.146436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.146718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.165221 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.165501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.165771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.166037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.166207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.166572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.167079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.167357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.174111 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.175457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.175864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.176146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.177176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.177458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.179385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.179672 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.179957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.180243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.180533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.180662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.180869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.181153 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.181438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.183856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.194721 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.195010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.195297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.195584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.195866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.197448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.198266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.198463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.198624 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.198774 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.199044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.199334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.199625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.199922 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.216957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.218382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.220306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.221698 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.223677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.225131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.225445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.226786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.227131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.227417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.227713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.228464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.228968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.229302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.235397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.236869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.237031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.238522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.240345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.240638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.241033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.241321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.241761 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.242065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.242411 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.242705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.251260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.251549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.251833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.252689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.252981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.253272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.259808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.260714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.260977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.261256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.261531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.261900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80387) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 11 13:58:31.261986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.262204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.262291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.262489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.262572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.262767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.262860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.263042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.263124 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.263321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.263455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.263597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.263679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.263870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.263953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.264143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.264225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.264434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.264808 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.265078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.265349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.265634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80387) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 11 13:58:31.303072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55faf56019c0 pid: 80388 (default app) Jul 11 13:58:31.304780 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55faf56019c0 pid: 80387 (default app) Jul 11 13:58:31.306531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93096f-5107-49ab-bb25-6ca5b91d55e3 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:31.306849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93096f-5107-49ab-bb25-6ca5b91d55e3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:31.307664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93096f-5107-49ab-bb25-6ca5b91d55e3 None None] PATH_INFO: `/v3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:31.311939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 791 bytes} [Mon Jul 11 13:58:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:39.175404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b2e21-f43b-4c2b-9924-413a1b08cad5 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:39.175981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b2e21-f43b-4c2b-9924-413a1b08cad5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:39.175981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b2e21-f43b-4c2b-9924-413a1b08cad5 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:39.180511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:58:39.185966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240a68-53c4-4c19-914c-8ef895068653 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:39.186464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240a68-53c4-4c19-914c-8ef895068653 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:39.186559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240a68-53c4-4c19-914c-8ef895068653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:39.256325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: INFO dbcounter [None req-e6240a68-53c4-4c19-914c-8ef895068653 None None] Registered counter for database keystone Jul 11 13:58:39.278642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG oslo_db.sqlalchemy.engines [None req-e6240a68-53c4-4c19-914c-8ef895068653 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:58:39.285366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writer thread running {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:58:39.464820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG passlib.handlers.bcrypt [None req-e6240a68-53c4-4c19-914c-8ef895068653 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80388) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 13:58:39.465151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG passlib.handlers.bcrypt [None req-e6240a68-53c4-4c19-914c-8ef895068653 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80388) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 13:58:39.520763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e6240a68-53c4-4c19-914c-8ef895068653 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:39.522446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e6240a68-53c4-4c19-914c-8ef895068653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:39.647391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 2/3] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 11 13:58:39.825016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b2e21-f43b-4c2b-9924-413a1b08cad5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:39.895908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: INFO dbcounter [None req-316b2e21-f43b-4c2b-9924-413a1b08cad5 None None] Registered counter for database keystone Jul 11 13:58:39.917016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG oslo_db.sqlalchemy.engines [None req-316b2e21-f43b-4c2b-9924-413a1b08cad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 11 13:58:39.923855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writer thread running {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 11 13:58:40.048657 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b2e21-f43b-4c2b-9924-413a1b08cad5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:40.052963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0012d-f386-4487-902f-ea7c035cb8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:40.053631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0012d-f386-4487-902f-ea7c035cb8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:40.053918 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0012d-f386-4487-902f-ea7c035cb8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:40.054227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0012d-f386-4487-902f-ea7c035cb8c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:40.062507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0012d-f386-4487-902f-ea7c035cb8c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:40.114069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: WARNING keystone.common.rbac_enforcer.enforcer [None req-37d0012d-f386-4487-902f-ea7c035cb8c5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 13:58:40.114366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0012d-f386-4487-902f-ea7c035cb8c5 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:40.124633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1324 bytes} [Mon Jul 11 13:58:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 13:58:40.131038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6240a68-53c4-4c19-914c-8ef895068653 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:40.145847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6240a68-53c4-4c19-914c-8ef895068653 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:40.150381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18a85a-e275-4b8a-aaed-2c2f2cf5f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:40.151997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18a85a-e275-4b8a-aaed-2c2f2cf5f2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:40.152283 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18a85a-e275-4b8a-aaed-2c2f2cf5f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:40.152559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18a85a-e275-4b8a-aaed-2c2f2cf5f2f9 admin admin] PATH_INFO: `/v3/projects/53f35d51b66c4aec847015cb4a904c77` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:40.154077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18a85a-e275-4b8a-aaed-2c2f2cf5f2f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=53f35d51b66c4aec847015cb4a904c77)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:40.206733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8c18a85a-e275-4b8a-aaed-2c2f2cf5f2f9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 11 13:58:40.207283 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18a85a-e275-4b8a-aaed-2c2f2cf5f2f9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:40.211754 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 3/5] 10.222.0.66 () {56 vars in 1207 bytes} [Mon Jul 11 13:58:40 2022] GET /identity/v3/projects/53f35d51b66c4aec847015cb4a904c77 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:42.317509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d082ad-fe28-4d2d-b50b-b5ac83a18902 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:42.318039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d082ad-fe28-4d2d-b50b-b5ac83a18902 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:42.318039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d082ad-fe28-4d2d-b50b-b5ac83a18902 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:42.322268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 3/6] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:42.327774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31643a-42b4-4afb-b540-8d78b280ab2d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:42.328221 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31643a-42b4-4afb-b540-8d78b280ab2d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:42.328340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31643a-42b4-4afb-b540-8d78b280ab2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:42.347403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6f31643a-42b4-4afb-b540-8d78b280ab2d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:42.348967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6f31643a-42b4-4afb-b540-8d78b280ab2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:42.357617 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 11 13:58:42.379771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d082ad-fe28-4d2d-b50b-b5ac83a18902 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:42.392658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d082ad-fe28-4d2d-b50b-b5ac83a18902 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:42.397242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b78bd-630d-4f8a-b2a6-5816b8f42180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:42.397940 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b78bd-630d-4f8a-b2a6-5816b8f42180 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:42.398256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b78bd-630d-4f8a-b2a6-5816b8f42180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:42.398543 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b78bd-630d-4f8a-b2a6-5816b8f42180 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:42.407466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b78bd-630d-4f8a-b2a6-5816b8f42180 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:42.409260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b78bd-630d-4f8a-b2a6-5816b8f42180 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:42.418640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1324 bytes} [Mon Jul 11 13:58:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 13:58:42.424546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31643a-42b4-4afb-b540-8d78b280ab2d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:42.433567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31643a-42b4-4afb-b540-8d78b280ab2d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:42.438052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee8f32-c9fd-4489-86ea-d6e4e9d82c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:42.438956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8f32-c9fd-4489-86ea-d6e4e9d82c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:42.439238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8f32-c9fd-4489-86ea-d6e4e9d82c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:42.439512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8f32-c9fd-4489-86ea-d6e4e9d82c80 admin admin] PATH_INFO: `/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:42.440897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee8f32-c9fd-4489-86ea-d6e4e9d82c80 admin admin] RBAC: Authorizing `identity:get_user(user_id=477dddd95e9e4c9dab1e4c703d6c3e08)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:42.442759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee8f32-c9fd-4489-86ea-d6e4e9d82c80 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:42.444333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 5/9] 10.222.0.66 () {56 vars in 1198 bytes} [Mon Jul 11 13:58:42 2022] GET /identity/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:44.561513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45076fa-f2fd-4562-9af3-743b13d58318 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:44.562019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45076fa-f2fd-4562-9af3-743b13d58318 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:44.562019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45076fa-f2fd-4562-9af3-743b13d58318 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:44.563377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:44.568725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0836be-0e9b-480f-b5bc-dd56bcd43807 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:44.569186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0836be-0e9b-480f-b5bc-dd56bcd43807 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:44.569296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0836be-0e9b-480f-b5bc-dd56bcd43807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:44.571913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b529-d904-4bc5-a992-1c6790d993a3 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:44.572205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b529-d904-4bc5-a992-1c6790d993a3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:44.572518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584b529-d904-4bc5-a992-1c6790d993a3 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:44.573818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 6/11] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:58:44.579386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f090-8c22-4f9d-a7eb-f4b65424fd6d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:44.579673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f090-8c22-4f9d-a7eb-f4b65424fd6d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:44.579948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9f090-8c22-4f9d-a7eb-f4b65424fd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:44.587119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4b0836be-0e9b-480f-b5bc-dd56bcd43807 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:44.588927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4b0836be-0e9b-480f-b5bc-dd56bcd43807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:44.621078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG passlib.handlers.bcrypt [None req-54c9f090-8c22-4f9d-a7eb-f4b65424fd6d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80387) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 11 13:58:44.621493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG passlib.handlers.bcrypt [None req-54c9f090-8c22-4f9d-a7eb-f4b65424fd6d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80387) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 11 13:58:44.668003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-54c9f090-8c22-4f9d-a7eb-f4b65424fd6d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:44.669618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-54c9f090-8c22-4f9d-a7eb-f4b65424fd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:44.672915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 6/12] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:44.695893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0836be-0e9b-480f-b5bc-dd56bcd43807 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:44.721069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:44.775314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 7/13] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:58:44.799695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f090-8c22-4f9d-a7eb-f4b65424fd6d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:44.805288 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0836be-0e9b-480f-b5bc-dd56bcd43807 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:44.840162 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b50eb-bef8-4d9f-bc16-17c2eb1b23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:44.840804 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b50eb-bef8-4d9f-bc16-17c2eb1b23d1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:44.841088 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b50eb-bef8-4d9f-bc16-17c2eb1b23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:44.841364 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b50eb-bef8-4d9f-bc16-17c2eb1b23d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:44.904254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9f090-8c22-4f9d-a7eb-f4b65424fd6d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:44.906695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:44.910763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b50eb-bef8-4d9f-bc16-17c2eb1b23d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:44.912251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b50eb-bef8-4d9f-bc16-17c2eb1b23d1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:44.940864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:44.944773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef8d22-7d1f-4261-8fc0-9c9fd49b872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:44.945845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8d22-7d1f-4261-8fc0-9c9fd49b872c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:44.946135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8d22-7d1f-4261-8fc0-9c9fd49b872c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:44.946449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef8d22-7d1f-4261-8fc0-9c9fd49b872c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:44.958849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef8d22-7d1f-4261-8fc0-9c9fd49b872c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-41ef8d22-7d1f-4261-8fc0-9c9fd49b872c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:58:44.970391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:44.971346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:58:44.972167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 8/14] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:58:44.977723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef8d22-7d1f-4261-8fc0-9c9fd49b872c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:45.019711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 7/15] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 13:58:45.025351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b50eb-bef8-4d9f-bc16-17c2eb1b23d1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:45.083874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef8d22-7d1f-4261-8fc0-9c9fd49b872c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:45.118642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288574c-87c7-450c-bc14-8352abe759ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:45.119385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288574c-87c7-450c-bc14-8352abe759ca None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:45.120161 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288574c-87c7-450c-bc14-8352abe759ca None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:45.120455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288574c-87c7-450c-bc14-8352abe759ca None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:45.121221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288574c-87c7-450c-bc14-8352abe759ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:45.121526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288574c-87c7-450c-bc14-8352abe759ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:45.123005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288574c-87c7-450c-bc14-8352abe759ca None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:45.126452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b50eb-bef8-4d9f-bc16-17c2eb1b23d1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:45.135263 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 9/16] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:58:45.140903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288574c-87c7-450c-bc14-8352abe759ca None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:45.150428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:45.164026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745b12f-d67a-4ff1-8cab-1592a7316676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:45.164830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745b12f-d67a-4ff1-8cab-1592a7316676 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:45.165113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745b12f-d67a-4ff1-8cab-1592a7316676 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:45.165386 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745b12f-d67a-4ff1-8cab-1592a7316676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:45.170753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:45.176840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745b12f-d67a-4ff1-8cab-1592a7316676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:45.178341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a745b12f-d67a-4ff1-8cab-1592a7316676 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a745b12f-d67a-4ff1-8cab-1592a7316676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:58:45.201590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:45.202550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:45.203355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:58:45.203355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:58:45.203355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:45.203355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:58:45.203355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 8/17] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:58:45.208681 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745b12f-d67a-4ff1-8cab-1592a7316676 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:45.250064 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288574c-87c7-450c-bc14-8352abe759ca None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:45.288333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2988c-fc3d-4355-a485-66ba57566963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:45.289253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2988c-fc3d-4355-a485-66ba57566963 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:45.289534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2988c-fc3d-4355-a485-66ba57566963 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:45.289812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2988c-fc3d-4355-a485-66ba57566963 None admin] PATH_INFO: `/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:45.292016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2988c-fc3d-4355-a485-66ba57566963 None admin] RBAC: Authorizing `identity:get_user(user_id=477dddd95e9e4c9dab1e4c703d6c3e08)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:45.293701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2988c-fc3d-4355-a485-66ba57566963 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:45.295389 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 10/18] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:58:45 2022] GET /identity/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:58:45.300837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2988c-fc3d-4355-a485-66ba57566963 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:45.317100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745b12f-d67a-4ff1-8cab-1592a7316676 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:45.351737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441aba7-6564-4605-845a-8cc9b6a493a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:45.352416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441aba7-6564-4605-845a-8cc9b6a493a9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:45.352718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441aba7-6564-4605-845a-8cc9b6a493a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:45.352987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441aba7-6564-4605-845a-8cc9b6a493a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:45.354391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441aba7-6564-4605-845a-8cc9b6a493a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:45.354705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441aba7-6564-4605-845a-8cc9b6a493a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:45.356118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441aba7-6564-4605-845a-8cc9b6a493a9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:45.374815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 9/19] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:58:45.407818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:45.415757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2988c-fc3d-4355-a485-66ba57566963 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:45.453465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8c30e-8d5d-45f6-909d-a7c871167da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:45.454325 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c30e-8d5d-45f6-909d-a7c871167da7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:45.454619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c30e-8d5d-45f6-909d-a7c871167da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:45.454902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8c30e-8d5d-45f6-909d-a7c871167da7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:45.456218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c30e-8d5d-45f6-909d-a7c871167da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:45.457732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8c30e-8d5d-45f6-909d-a7c871167da7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:45.459497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 11/20] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:45.465896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441aba7-6564-4605-845a-8cc9b6a493a9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:45.506168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:45.582733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441aba7-6564-4605-845a-8cc9b6a493a9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:45.622388 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d150f6-a9bf-4700-a945-187bfd60832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:45.623078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d150f6-a9bf-4700-a945-187bfd60832d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:45.623365 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d150f6-a9bf-4700-a945-187bfd60832d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:45.623648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d150f6-a9bf-4700-a945-187bfd60832d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:45.624504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d150f6-a9bf-4700-a945-187bfd60832d None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.domain.id=default, user.id=477dddd95e9e4c9dab1e4c703d6c3e08) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:45.624883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d150f6-a9bf-4700-a945-187bfd60832d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:45.626382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d150f6-a9bf-4700-a945-187bfd60832d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:45.634363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 10/21] 10.222.0.66 () {56 vars in 1322 bytes} [Mon Jul 11 13:58:45 2022] GET /identity/v3/role_assignments?user.id=477dddd95e9e4c9dab1e4c703d6c3e08&scope.domain.id=default&role.id=57f1335a97b5490cb0853894c2faf62c => generated 233 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:48.116970 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076779-7078-4ed9-8685-76f7f05a3927 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:48.118072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076779-7078-4ed9-8685-76f7f05a3927 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:48.118682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076779-7078-4ed9-8685-76f7f05a3927 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:48.120801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 12/22] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:48.126169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da2057-dd2c-4a3b-95c8-3e5d7e98c86f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:48.127037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da2057-dd2c-4a3b-95c8-3e5d7e98c86f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:48.127544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da2057-dd2c-4a3b-95c8-3e5d7e98c86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:48.155222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-55da2057-dd2c-4a3b-95c8-3e5d7e98c86f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:48.156788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-55da2057-dd2c-4a3b-95c8-3e5d7e98c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:48.248502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 11/23] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:48.272315 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a26542-4473-4f83-96eb-145e8c875746 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:48.272628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a26542-4473-4f83-96eb-145e8c875746 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:48.272896 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a26542-4473-4f83-96eb-145e8c875746 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:48.274302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:48.285124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da2057-dd2c-4a3b-95c8-3e5d7e98c86f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:48.302131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbb803-505b-4548-a50c-42468ec61649 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:48.302447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbb803-505b-4548-a50c-42468ec61649 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:48.302739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbb803-505b-4548-a50c-42468ec61649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:48.329695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-21bbb803-505b-4548-a50c-42468ec61649 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:48.330959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-21bbb803-505b-4548-a50c-42468ec61649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:48.346393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:48.445145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 14/25] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:58:48.447467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540264ef-e5db-42da-bca2-3e44f03eea97 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:48.447980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540264ef-e5db-42da-bca2-3e44f03eea97 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:48.448467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540264ef-e5db-42da-bca2-3e44f03eea97 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:48.449981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 15/26] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:48.451755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc182c-e542-46d8-a3c1-950133f0b38c None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:48.452280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc182c-e542-46d8-a3c1-950133f0b38c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:48.452767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc182c-e542-46d8-a3c1-950133f0b38c None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:48.454224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 16/27] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:48.464378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475073-bd62-4ddf-a745-44f98056bb7a None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:48.465019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475073-bd62-4ddf-a745-44f98056bb7a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:48.465526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4475073-bd62-4ddf-a745-44f98056bb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:48.468097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da2057-dd2c-4a3b-95c8-3e5d7e98c86f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:48.488898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b4475073-bd62-4ddf-a745-44f98056bb7a None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:48.491185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b4475073-bd62-4ddf-a745-44f98056bb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:48.515709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59560b9-279c-4d8a-a48e-acf8725eabe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:48.516949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59560b9-279c-4d8a-a48e-acf8725eabe1 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:48.517239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59560b9-279c-4d8a-a48e-acf8725eabe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:48.517519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59560b9-279c-4d8a-a48e-acf8725eabe1 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:48.518748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59560b9-279c-4d8a-a48e-acf8725eabe1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:48.521266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59560b9-279c-4d8a-a48e-acf8725eabe1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:48.574724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 17/28] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:48.576364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac20fb9-84e3-4066-9539-fc13afb4959b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:48.576795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac20fb9-84e3-4066-9539-fc13afb4959b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:48.577276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac20fb9-84e3-4066-9539-fc13afb4959b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:48.596311 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-eac20fb9-84e3-4066-9539-fc13afb4959b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:48.597807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-eac20fb9-84e3-4066-9539-fc13afb4959b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:48.616816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:48.670114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 12/29] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Jul 11 13:58:48 2022] POST /identity/v3/roles => generated 219 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:58:48.678181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59560b9-279c-4d8a-a48e-acf8725eabe1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:48.678362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 18/30] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:48.678362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac20fb9-84e3-4066-9539-fc13afb4959b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:48.795797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac20fb9-84e3-4066-9539-fc13afb4959b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:48.808750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:48.823130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59560b9-279c-4d8a-a48e-acf8725eabe1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:48.835251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd7dde-4e3d-47e4-b6cf-ce61609b4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:48.836076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd7dde-4e3d-47e4-b6cf-ce61609b4804 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:48.836429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd7dde-4e3d-47e4-b6cf-ce61609b4804 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:48.836626 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd7dde-4e3d-47e4-b6cf-ce61609b4804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:48.859515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd7dde-4e3d-47e4-b6cf-ce61609b4804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:48.861136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd7dde-4e3d-47e4-b6cf-ce61609b4804 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:48.862379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f808b4-67c8-44f8-b82d-fc07ec1adf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:48.863669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f808b4-67c8-44f8-b82d-fc07ec1adf26 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:48.864171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f808b4-67c8-44f8-b82d-fc07ec1adf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:48.865013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f808b4-67c8-44f8-b82d-fc07ec1adf26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:48.879686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f808b4-67c8-44f8-b82d-fc07ec1adf26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-38cd7dde-4e3d-47e4-b6cf-ce61609b4804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:58:48.883505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:48.884358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:48.885951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:58:48.885951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:58:48.885951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:58:48.885951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:58:48.885951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 19/31] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:48.887184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd7dde-4e3d-47e4-b6cf-ce61609b4804 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:48.898430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-36f808b4-67c8-44f8-b82d-fc07ec1adf26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:58:48.907979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:48.908886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:58:48.909667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:58:48.912219 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 13/32] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:48.915035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f808b4-67c8-44f8-b82d-fc07ec1adf26 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:49.053913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd7dde-4e3d-47e4-b6cf-ce61609b4804 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:49.058321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f808b4-67c8-44f8-b82d-fc07ec1adf26 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:49.098052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be95d2-2592-44b8-83da-a67d5f48c345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:49.098766 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be95d2-2592-44b8-83da-a67d5f48c345 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.099053 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be95d2-2592-44b8-83da-a67d5f48c345 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.099335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be95d2-2592-44b8-83da-a67d5f48c345 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.100422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be95d2-2592-44b8-83da-a67d5f48c345 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:49.101824 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be95d2-2592-44b8-83da-a67d5f48c345 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:49.102344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06869fcc-495e-4034-9d13-c4a2d4d8bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:49.103025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869fcc-495e-4034-9d13-c4a2d4d8bddf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.103313 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869fcc-495e-4034-9d13-c4a2d4d8bddf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.103691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869fcc-495e-4034-9d13-c4a2d4d8bddf None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.104608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06869fcc-495e-4034-9d13-c4a2d4d8bddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:49.104923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06869fcc-495e-4034-9d13-c4a2d4d8bddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:49.106547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06869fcc-495e-4034-9d13-c4a2d4d8bddf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:49.123818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 14/33] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:49.123818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06869fcc-495e-4034-9d13-c4a2d4d8bddf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:49.137481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:49.237265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 20/34] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Jul 11 13:58:48 2022] POST /identity/v3/roles => generated 225 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:58:49.250392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054de8c-be93-4e5e-89d1-b9fd89ca3bd3 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.250392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054de8c-be93-4e5e-89d1-b9fd89ca3bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.250392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054de8c-be93-4e5e-89d1-b9fd89ca3bd3 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.250392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 21/35] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:49.250392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054de8c-be93-4e5e-89d1-b9fd89ca3bd3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:49.343301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:49.374144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06869fcc-495e-4034-9d13-c4a2d4d8bddf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:49.396112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054de8c-be93-4e5e-89d1-b9fd89ca3bd3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:49.426140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94923c-0bf6-4591-b040-6432381c2ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:49.426961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94923c-0bf6-4591-b040-6432381c2ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.427262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94923c-0bf6-4591-b040-6432381c2ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.427565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94923c-0bf6-4591-b040-6432381c2ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.428321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94923c-0bf6-4591-b040-6432381c2ac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:49.428634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94923c-0bf6-4591-b040-6432381c2ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:49.430376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94923c-0bf6-4591-b040-6432381c2ac1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:49.444922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 15/36] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:49.445965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2668f6-db0c-4bad-bd39-8d4b467be929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:49.446374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a180b-b3c8-41b5-9012-30a2322e57a1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.446671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a180b-b3c8-41b5-9012-30a2322e57a1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.446956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a180b-b3c8-41b5-9012-30a2322e57a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.447750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2668f6-db0c-4bad-bd39-8d4b467be929 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.448258 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2668f6-db0c-4bad-bd39-8d4b467be929 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.448792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2668f6-db0c-4bad-bd39-8d4b467be929 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.449779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2668f6-db0c-4bad-bd39-8d4b467be929 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:49.451744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2668f6-db0c-4bad-bd39-8d4b467be929 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:49.469135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fe9a180b-b3c8-41b5-9012-30a2322e57a1 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:49.470941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fe9a180b-b3c8-41b5-9012-30a2322e57a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:49.491707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 22/37] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 13:58:49 2022] POST /identity/v3/projects => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:58:49.492924 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2668f6-db0c-4bad-bd39-8d4b467be929 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:49.549525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:49.562623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 16/38] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:49.566477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e6b14-7644-4813-9593-9c361dfb0750 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.566747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e6b14-7644-4813-9593-9c361dfb0750 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.566976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e6b14-7644-4813-9593-9c361dfb0750 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.568392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 17/39] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:58:49.574181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774aca-f47b-47e5-b1f7-33821d260d39 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.574711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774aca-f47b-47e5-b1f7-33821d260d39 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.575248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45774aca-f47b-47e5-b1f7-33821d260d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.595775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-45774aca-f47b-47e5-b1f7-33821d260d39 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:49.597275 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-45774aca-f47b-47e5-b1f7-33821d260d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:49.624753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2668f6-db0c-4bad-bd39-8d4b467be929 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:49.644625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:49.668370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f66b3-7745-41d5-9a9d-083788b95397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:49.668633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f66b3-7745-41d5-9a9d-083788b95397 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.668925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f66b3-7745-41d5-9a9d-083788b95397 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.669212 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f66b3-7745-41d5-9a9d-083788b95397 None admin] PATH_INFO: `/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.670613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f66b3-7745-41d5-9a9d-083788b95397 None admin] RBAC: Authorizing `identity:get_user(user_id=477dddd95e9e4c9dab1e4c703d6c3e08)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:49.672077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f66b3-7745-41d5-9a9d-083788b95397 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:49.673746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 23/40] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:58:49 2022] GET /identity/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:49.675507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f66b3-7745-41d5-9a9d-083788b95397 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:49.684016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 18/41] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:49.684711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774aca-f47b-47e5-b1f7-33821d260d39 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:49.789170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f66b3-7745-41d5-9a9d-083788b95397 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:49.806385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45774aca-f47b-47e5-b1f7-33821d260d39 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:49.823966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbd604-41b0-4477-bdb6-7e88532c3dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:49.824644 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbd604-41b0-4477-bdb6-7e88532c3dc1 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.824931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbd604-41b0-4477-bdb6-7e88532c3dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.825210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbd604-41b0-4477-bdb6-7e88532c3dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.825962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bbd604-41b0-4477-bdb6-7e88532c3dc1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:49.827377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bbd604-41b0-4477-bdb6-7e88532c3dc1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:49.835307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:49.841303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 24/42] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Jul 11 13:58:49 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:58:49.842133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbd604-41b0-4477-bdb6-7e88532c3dc1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:49.843024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86266bbf-2737-4909-b9c5-f10ed1e2cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:49.844078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86266bbf-2737-4909-b9c5-f10ed1e2cd7d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:49.844719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86266bbf-2737-4909-b9c5-f10ed1e2cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:49.845195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86266bbf-2737-4909-b9c5-f10ed1e2cd7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:49.846881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86266bbf-2737-4909-b9c5-f10ed1e2cd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:49.848724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86266bbf-2737-4909-b9c5-f10ed1e2cd7d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:49.850939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 19/43] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:49.858489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86266bbf-2737-4909-b9c5-f10ed1e2cd7d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:49.896209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:49.966022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbd604-41b0-4477-bdb6-7e88532c3dc1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:49.980459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86266bbf-2737-4909-b9c5-f10ed1e2cd7d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:50.004376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0344b1-afb5-45d2-afe2-ed423fc6d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:50.005270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0344b1-afb5-45d2-afe2-ed423fc6d89c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:50.005563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0344b1-afb5-45d2-afe2-ed423fc6d89c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:50.005845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0344b1-afb5-45d2-afe2-ed423fc6d89c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:50.007075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0344b1-afb5-45d2-afe2-ed423fc6d89c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:50.008547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0344b1-afb5-45d2-afe2-ed423fc6d89c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:50.010769 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 25/44] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:50.016818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0344b1-afb5-45d2-afe2-ed423fc6d89c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:50.020365 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e671e2-3182-46ef-97a5-81aa0603d90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:50.021270 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e671e2-3182-46ef-97a5-81aa0603d90e None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:50.021551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e671e2-3182-46ef-97a5-81aa0603d90e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:50.021839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e671e2-3182-46ef-97a5-81aa0603d90e None admin] PATH_INFO: `/v3/domains/default/users/477dddd95e9e4c9dab1e4c703d6c3e08/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:50.023971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e671e2-3182-46ef-97a5-81aa0603d90e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=477dddd95e9e4c9dab1e4c703d6c3e08, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:50.026129 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e671e2-3182-46ef-97a5-81aa0603d90e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:50.042766 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 20/45] 10.222.0.66 () {58 vars in 1361 bytes} [Mon Jul 11 13:58:49 2022] PUT /identity/v3/domains/default/users/477dddd95e9e4c9dab1e4c703d6c3e08/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 13:58:50.132115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0344b1-afb5-45d2-afe2-ed423fc6d89c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:50.147983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:50.172802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ea8ce-34c8-409f-9bb6-d0a69ac7fd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:50.173488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea8ce-34c8-409f-9bb6-d0a69ac7fd04 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:50.173785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea8ce-34c8-409f-9bb6-d0a69ac7fd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:50.174089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea8ce-34c8-409f-9bb6-d0a69ac7fd04 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:50.174870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ea8ce-34c8-409f-9bb6-d0a69ac7fd04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:50.176366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ea8ce-34c8-409f-9bb6-d0a69ac7fd04 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:50.208238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 26/46] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 13:58:50 2022] POST /identity/v3/projects => generated 312 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:58:52.076805 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd74b0-6596-48bc-b070-fb49db02e826 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:52.077323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd74b0-6596-48bc-b070-fb49db02e826 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:52.077425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd74b0-6596-48bc-b070-fb49db02e826 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:52.078864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 21/47] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:52.084017 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2024410-fe5c-437c-b4aa-b9adfa339ec7 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:52.084393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2024410-fe5c-437c-b4aa-b9adfa339ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:52.084580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2024410-fe5c-437c-b4aa-b9adfa339ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:52.101553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f2024410-fe5c-437c-b4aa-b9adfa339ec7 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:52.103090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f2024410-fe5c-437c-b4aa-b9adfa339ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:52.172905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 27/48] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:52.199346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd74b0-6596-48bc-b070-fb49db02e826 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:52.261307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:52.285041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687855d3-990c-4ba8-970b-f79a54dfbcab None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:52.285347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687855d3-990c-4ba8-970b-f79a54dfbcab None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:52.285637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687855d3-990c-4ba8-970b-f79a54dfbcab None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:52.287102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 28/49] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:58:52.292455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aff76-72f5-459f-9928-2d145a8862f0 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:52.292745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aff76-72f5-459f-9928-2d145a8862f0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:52.293033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aff76-72f5-459f-9928-2d145a8862f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:52.305576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd74b0-6596-48bc-b070-fb49db02e826 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:52.309913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-587aff76-72f5-459f-9928-2d145a8862f0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:52.312659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-587aff76-72f5-459f-9928-2d145a8862f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:52.340971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a01ecd-2a09-42f7-b4ee-e643fe3e0b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:52.341728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01ecd-2a09-42f7-b4ee-e643fe3e0b39 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:52.342014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01ecd-2a09-42f7-b4ee-e643fe3e0b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:52.342327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01ecd-2a09-42f7-b4ee-e643fe3e0b39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:52.353275 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a01ecd-2a09-42f7-b4ee-e643fe3e0b39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-42a01ecd-2a09-42f7-b4ee-e643fe3e0b39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:58:52.361598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:52.362648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:58:52.363424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 22/50] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:58:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:52.368628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a01ecd-2a09-42f7-b4ee-e643fe3e0b39 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:52.382073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 29/51] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:58:52.404741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aff76-72f5-459f-9928-2d145a8862f0 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:52.428959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:52.471231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a01ecd-2a09-42f7-b4ee-e643fe3e0b39 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:52.489525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:52.507474 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afe92c-3a00-4210-8390-4e575d210432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:52.508053 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aff76-72f5-459f-9928-2d145a8862f0 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:52.508155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afe92c-3a00-4210-8390-4e575d210432 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:52.508434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afe92c-3a00-4210-8390-4e575d210432 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:52.508719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afe92c-3a00-4210-8390-4e575d210432 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:52.509561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afe92c-3a00-4210-8390-4e575d210432 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:52.509854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afe92c-3a00-4210-8390-4e575d210432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:52.511573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03afe92c-3a00-4210-8390-4e575d210432 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:52.520907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 23/52] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:58:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:58:52.526899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afe92c-3a00-4210-8390-4e575d210432 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:52.635897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03afe92c-3a00-4210-8390-4e575d210432 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:52.647299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15770b8-96be-4a5b-89f6-f46161c0fbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:52.648106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15770b8-96be-4a5b-89f6-f46161c0fbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:52.648394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15770b8-96be-4a5b-89f6-f46161c0fbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:52.648682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15770b8-96be-4a5b-89f6-f46161c0fbd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:52.649859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15770b8-96be-4a5b-89f6-f46161c0fbd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:52.651484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15770b8-96be-4a5b-89f6-f46161c0fbd3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:52.653427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 30/53] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:58:52.658582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15770b8-96be-4a5b-89f6-f46161c0fbd3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:52.669902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08181ad-ad13-4077-90d0-575b8c847dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:52.670871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08181ad-ad13-4077-90d0-575b8c847dba None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:52.671154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08181ad-ad13-4077-90d0-575b8c847dba None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:52.671440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08181ad-ad13-4077-90d0-575b8c847dba None admin] PATH_INFO: `/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:52.672649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08181ad-ad13-4077-90d0-575b8c847dba None admin] RBAC: Authorizing `identity:get_user(user_id=477dddd95e9e4c9dab1e4c703d6c3e08)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:52.674111 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08181ad-ad13-4077-90d0-575b8c847dba None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:52.675762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 24/54] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:58:52 2022] GET /identity/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:52.681179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08181ad-ad13-4077-90d0-575b8c847dba None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:52.730989 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:52.756879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:52.767720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15770b8-96be-4a5b-89f6-f46161c0fbd3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:52.785037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08181ad-ad13-4077-90d0-575b8c847dba None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:52.805581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9396a4-e61d-4a57-a294-1c00886d3822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:52.806288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9396a4-e61d-4a57-a294-1c00886d3822 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:52.806587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9396a4-e61d-4a57-a294-1c00886d3822 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:52.806870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9396a4-e61d-4a57-a294-1c00886d3822 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:52.807600 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9396a4-e61d-4a57-a294-1c00886d3822 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:52.809056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9396a4-e61d-4a57-a294-1c00886d3822 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:52.820197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a216e1f-4ce6-45a9-b29b-c30fa6301791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:52.820994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a216e1f-4ce6-45a9-b29b-c30fa6301791 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:52.821284 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a216e1f-4ce6-45a9-b29b-c30fa6301791 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:52.821571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a216e1f-4ce6-45a9-b29b-c30fa6301791 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:52.823069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a216e1f-4ce6-45a9-b29b-c30fa6301791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:52.824590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a216e1f-4ce6-45a9-b29b-c30fa6301791 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:52.826323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 25/55] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:58:52.832234 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a216e1f-4ce6-45a9-b29b-c30fa6301791 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:52.834955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 31/56] 10.222.0.66 () {60 vars in 1140 bytes} [Mon Jul 11 13:58:52 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:58:52.955998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a216e1f-4ce6-45a9-b29b-c30fa6301791 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:52.973472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:52.992873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da672c-d8ce-43dc-8dff-99b41b0706a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:52.993556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da672c-d8ce-43dc-8dff-99b41b0706a8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:52.993844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da672c-d8ce-43dc-8dff-99b41b0706a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:52.994655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da672c-d8ce-43dc-8dff-99b41b0706a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:52.995523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da672c-d8ce-43dc-8dff-99b41b0706a8 None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.domain.id=default, user.id=477dddd95e9e4c9dab1e4c703d6c3e08) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:52.995838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da672c-d8ce-43dc-8dff-99b41b0706a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:52.997374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da672c-d8ce-43dc-8dff-99b41b0706a8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:53.003519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 26/57] 10.222.0.66 () {56 vars in 1322 bytes} [Mon Jul 11 13:58:52 2022] GET /identity/v3/role_assignments?user.id=477dddd95e9e4c9dab1e4c703d6c3e08&scope.domain.id=default&role.id=57f1335a97b5490cb0853894c2faf62c => generated 530 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:58:54.913197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cf0a0-3cb0-4379-834a-a31001615c4e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:54.913710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cf0a0-3cb0-4379-834a-a31001615c4e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:54.913879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cf0a0-3cb0-4379-834a-a31001615c4e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:54.915576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 32/58] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:54.920802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b83df-fc53-4f82-8daf-78506b71df4b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:54.921204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b83df-fc53-4f82-8daf-78506b71df4b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:54.921377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b83df-fc53-4f82-8daf-78506b71df4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:54.938545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-559b83df-fc53-4f82-8daf-78506b71df4b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:54.939776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-559b83df-fc53-4f82-8daf-78506b71df4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:55.006523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 27/59] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:55.032192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cf0a0-3cb0-4379-834a-a31001615c4e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:55.132501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cf0a0-3cb0-4379-834a-a31001615c4e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:55.165539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d03c7-bc87-4106-8651-0f5a35cf1c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:55.166402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d03c7-bc87-4106-8651-0f5a35cf1c63 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:55.166693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d03c7-bc87-4106-8651-0f5a35cf1c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:55.166975 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d03c7-bc87-4106-8651-0f5a35cf1c63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:55.168154 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d03c7-bc87-4106-8651-0f5a35cf1c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:55.169593 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d03c7-bc87-4106-8651-0f5a35cf1c63 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:55.171230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 33/60] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:55.176755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b83df-fc53-4f82-8daf-78506b71df4b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:55.277877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b83df-fc53-4f82-8daf-78506b71df4b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:55.288391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:55.313042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae24d9-80f6-491b-91fd-09a9c0d45c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:55.313723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae24d9-80f6-491b-91fd-09a9c0d45c1d None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:55.314014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae24d9-80f6-491b-91fd-09a9c0d45c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:55.314330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae24d9-80f6-491b-91fd-09a9c0d45c1d None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:55.315051 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae24d9-80f6-491b-91fd-09a9c0d45c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:55.316508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae24d9-80f6-491b-91fd-09a9c0d45c1d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:55.340968 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 28/61] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:58:55 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:58:58.481944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d4baa-e3d8-4e61-96d0-6918410693c7 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.482530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d4baa-e3d8-4e61-96d0-6918410693c7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.482530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d4baa-e3d8-4e61-96d0-6918410693c7 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:58.483963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 34/62] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:58.489299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca7aeb-1dd0-4929-818c-192b9bc98fae None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.489714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca7aeb-1dd0-4929-818c-192b9bc98fae None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.490011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca7aeb-1dd0-4929-818c-192b9bc98fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:58.519212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ceca7aeb-1dd0-4929-818c-192b9bc98fae None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:58.520706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ceca7aeb-1dd0-4929-818c-192b9bc98fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:58.619800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 29/63] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:58.668078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d4baa-e3d8-4e61-96d0-6918410693c7 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:58.694324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:58.814849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d4baa-e3d8-4e61-96d0-6918410693c7 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:58.859814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f1326-f660-48c4-bf72-bf1fc85b9b82 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.860115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f1326-f660-48c4-bf72-bf1fc85b9b82 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.860410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f1326-f660-48c4-bf72-bf1fc85b9b82 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:58.861839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 30/64] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:58.862777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43af5ac-3567-44c1-8d84-c568291474eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:58.863807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af5ac-3567-44c1-8d84-c568291474eb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.864275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af5ac-3567-44c1-8d84-c568291474eb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.864729 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43af5ac-3567-44c1-8d84-c568291474eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:58.871607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918be48-4f05-4416-8cf3-b08586594e67 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.871905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918be48-4f05-4416-8cf3-b08586594e67 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.872200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918be48-4f05-4416-8cf3-b08586594e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:58.877929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43af5ac-3567-44c1-8d84-c568291474eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-c43af5ac-3567-44c1-8d84-c568291474eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:58:58.890191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:58.891113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 35/65] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:58:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:58.891884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea51ed-427d-4105-ad20-169b236d667c None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.892564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea51ed-427d-4105-ad20-169b236d667c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.892564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea51ed-427d-4105-ad20-169b236d667c None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:58.892564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 36/66] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:58.898101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5918be48-4f05-4416-8cf3-b08586594e67 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:58.898853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea51ed-427d-4105-ad20-169b236d667c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:58.899362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5918be48-4f05-4416-8cf3-b08586594e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:58.982580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 31/67] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:58.983515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:58.983705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22632d9-bea2-447c-ad8a-b93aade31471 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:58.984002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22632d9-bea2-447c-ad8a-b93aade31471 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:58.984292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22632d9-bea2-447c-ad8a-b93aade31471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.011837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e22632d9-bea2-447c-ad8a-b93aade31471 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:59.013074 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e22632d9-bea2-447c-ad8a-b93aade31471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:59.024681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea51ed-427d-4105-ad20-169b236d667c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.036548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.073245 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717ffa3-114e-47c0-af8e-25e141c991d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.073887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717ffa3-114e-47c0-af8e-25e141c991d7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.074197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717ffa3-114e-47c0-af8e-25e141c991d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.074488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717ffa3-114e-47c0-af8e-25e141c991d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.075264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717ffa3-114e-47c0-af8e-25e141c991d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:59.075579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717ffa3-114e-47c0-af8e-25e141c991d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.076981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717ffa3-114e-47c0-af8e-25e141c991d7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.086261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 37/68] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:58:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:59.086918 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717ffa3-114e-47c0-af8e-25e141c991d7 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.098853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 32/69] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:59.101422 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa4d64-398e-47a7-aa2b-07c470f53ffa None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.101955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa4d64-398e-47a7-aa2b-07c470f53ffa None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.102476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa4d64-398e-47a7-aa2b-07c470f53ffa None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.106112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 33/70] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:59.107917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa4d64-398e-47a7-aa2b-07c470f53ffa None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.204944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717ffa3-114e-47c0-af8e-25e141c991d7 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.220369 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa4d64-398e-47a7-aa2b-07c470f53ffa None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.240088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b4b71-ef56-43f9-8346-815d876b4aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.240893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4b71-ef56-43f9-8346-815d876b4aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.241511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4b71-ef56-43f9-8346-815d876b4aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.241511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4b71-ef56-43f9-8346-815d876b4aa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.243338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.253256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b4b71-ef56-43f9-8346-815d876b4aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:58:59.256335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569729c-fdd1-429d-a245-075e2b983738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.257213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569729c-fdd1-429d-a245-075e2b983738 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.257500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569729c-fdd1-429d-a245-075e2b983738 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.257781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569729c-fdd1-429d-a245-075e2b983738 None admin] PATH_INFO: `/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-909b4b71-ef56-43f9-8346-815d876b4aa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:58:59.261534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:59.262441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:58:59.263197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 38/71] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:59.264312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c43096-1c50-48f9-9890-46d0708d27b2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.264312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c43096-1c50-48f9-9890-46d0708d27b2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.264577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c43096-1c50-48f9-9890-46d0708d27b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.274274 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569729c-fdd1-429d-a245-075e2b983738 None admin] RBAC: Authorizing `identity:get_user(user_id=9aeaa5e28ef143efbeeae1af9fd653f7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.275926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569729c-fdd1-429d-a245-075e2b983738 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.277904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 34/72] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:59.278528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569729c-fdd1-429d-a245-075e2b983738 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.284685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c8c43096-1c50-48f9-9890-46d0708d27b2 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:59.285943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c8c43096-1c50-48f9-9890-46d0708d27b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:59.294459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.355679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 39/73] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:59.356937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad405-dd9e-41f3-a253-740d281d476c None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.357234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad405-dd9e-41f3-a253-740d281d476c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.357518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad405-dd9e-41f3-a253-740d281d476c None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.359031 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 40/74] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:58:59.359569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ad405-dd9e-41f3-a253-740d281d476c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.389240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569729c-fdd1-429d-a245-075e2b983738 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.425058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd26080-bbaa-4817-82cb-c80b412e6a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.425875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd26080-bbaa-4817-82cb-c80b412e6a52 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.426167 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd26080-bbaa-4817-82cb-c80b412e6a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.426470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd26080-bbaa-4817-82cb-c80b412e6a52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.436573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd26080-bbaa-4817-82cb-c80b412e6a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-bbd26080-bbaa-4817-82cb-c80b412e6a52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:58:59.444695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:58:59.445725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 35/75] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:58:59.451459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd26080-bbaa-4817-82cb-c80b412e6a52 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.479301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ad405-dd9e-41f3-a253-740d281d476c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.503210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.514468 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e491690-82c2-49e9-96ca-90e12e9c8716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.515150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e491690-82c2-49e9-96ca-90e12e9c8716 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.515436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e491690-82c2-49e9-96ca-90e12e9c8716 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.515715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e491690-82c2-49e9-96ca-90e12e9c8716 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.516477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e491690-82c2-49e9-96ca-90e12e9c8716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:59.516786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e491690-82c2-49e9-96ca-90e12e9c8716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.518192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e491690-82c2-49e9-96ca-90e12e9c8716 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.524061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.527433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 41/76] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:59.528654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b93b5-ac48-4e43-8c04-b635c9550166 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.528930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b93b5-ac48-4e43-8c04-b635c9550166 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.529214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b93b5-ac48-4e43-8c04-b635c9550166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.546180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-635b93b5-ac48-4e43-8c04-b635c9550166 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:58:59.548029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-635b93b5-ac48-4e43-8c04-b635c9550166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:58:59.556418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd26080-bbaa-4817-82cb-c80b412e6a52 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.591530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e6258-1df2-4f6b-8941-965d2487e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.592195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e6258-1df2-4f6b-8941-965d2487e10c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.592486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e6258-1df2-4f6b-8941-965d2487e10c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.592771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e6258-1df2-4f6b-8941-965d2487e10c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.615136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 42/77] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:58:59.616359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b93b5-ac48-4e43-8c04-b635c9550166 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.662674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e6258-1df2-4f6b-8941-965d2487e10c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.664179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e6258-1df2-4f6b-8941-965d2487e10c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.724150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b93b5-ac48-4e43-8c04-b635c9550166 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.737187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.742022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.761261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6fd14-39a3-4e2b-82c2-a12c3cb01cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.762068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6fd14-39a3-4e2b-82c2-a12c3cb01cab None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.762392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6fd14-39a3-4e2b-82c2-a12c3cb01cab None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.762675 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6fd14-39a3-4e2b-82c2-a12c3cb01cab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.763299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 36/78] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:58:59.763961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6fd14-39a3-4e2b-82c2-a12c3cb01cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.764149 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e6258-1df2-4f6b-8941-965d2487e10c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.765442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6fd14-39a3-4e2b-82c2-a12c3cb01cab None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.768163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 43/79] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:59.768943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6fd14-39a3-4e2b-82c2-a12c3cb01cab None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.861996 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e6258-1df2-4f6b-8941-965d2487e10c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.871177 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6fd14-39a3-4e2b-82c2-a12c3cb01cab None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:58:59.903838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd1b08-23ef-44fd-8adc-95f10ca623a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.904522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1b08-23ef-44fd-8adc-95f10ca623a5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.904813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1b08-23ef-44fd-8adc-95f10ca623a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.905098 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1b08-23ef-44fd-8adc-95f10ca623a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.905293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e14f25-87cb-4cc4-be19-7cd57385ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:58:59.905856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1b08-23ef-44fd-8adc-95f10ca623a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:58:59.906202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e14f25-87cb-4cc4-be19-7cd57385ce30 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:58:59.906300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1b08-23ef-44fd-8adc-95f10ca623a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.906486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e14f25-87cb-4cc4-be19-7cd57385ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:58:59.906806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e14f25-87cb-4cc4-be19-7cd57385ce30 None admin] PATH_INFO: `/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:58:59.907603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1b08-23ef-44fd-8adc-95f10ca623a5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.908042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e14f25-87cb-4cc4-be19-7cd57385ce30 None admin] RBAC: Authorizing `identity:get_user(user_id=477dddd95e9e4c9dab1e4c703d6c3e08)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:58:59.909478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e14f25-87cb-4cc4-be19-7cd57385ce30 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:58:59.911471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 44/80] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:59.912250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e14f25-87cb-4cc4-be19-7cd57385ce30 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.916826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 37/81] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:58:59.917644 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd1b08-23ef-44fd-8adc-95f10ca623a5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:58:59.954285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:58:59.969796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:00.018500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e14f25-87cb-4cc4-be19-7cd57385ce30 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.020952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd1b08-23ef-44fd-8adc-95f10ca623a5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.054169 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b648f3-55b7-4950-933b-d57a4a0e28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.054998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b648f3-55b7-4950-933b-d57a4a0e28d2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.055284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b648f3-55b7-4950-933b-d57a4a0e28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.055562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b648f3-55b7-4950-933b-d57a4a0e28d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.057236 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913bf4-4bd1-4134-b91f-f1de47f66d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.058353 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913bf4-4bd1-4134-b91f-f1de47f66d03 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.058752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913bf4-4bd1-4134-b91f-f1de47f66d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.059133 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913bf4-4bd1-4134-b91f-f1de47f66d03 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.060478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3913bf4-4bd1-4134-b91f-f1de47f66d03 None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:00.061940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3913bf4-4bd1-4134-b91f-f1de47f66d03 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:00.063712 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 38/82] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:00.064473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913bf4-4bd1-4134-b91f-f1de47f66d03 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.071137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b648f3-55b7-4950-933b-d57a4a0e28d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-45b648f3-55b7-4950-933b-d57a4a0e28d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:00.079020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:00.079932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:00.080710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 45/83] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:58:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:00.081336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b648f3-55b7-4950-933b-d57a4a0e28d2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.173614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913bf4-4bd1-4134-b91f-f1de47f66d03 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.176186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:00.185772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b648f3-55b7-4950-933b-d57a4a0e28d2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.198537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:00.210963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c2adc-6c52-42d2-a599-8c3e7be27ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.211827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c2adc-6c52-42d2-a599-8c3e7be27ea9 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.212132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c2adc-6c52-42d2-a599-8c3e7be27ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.212421 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c2adc-6c52-42d2-a599-8c3e7be27ea9 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.213672 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c2adc-6c52-42d2-a599-8c3e7be27ea9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:00.215375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c2adc-6c52-42d2-a599-8c3e7be27ea9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:00.222303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc7687-8e0e-4709-bc82-6302a228c6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.222976 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc7687-8e0e-4709-bc82-6302a228c6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.223264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc7687-8e0e-4709-bc82-6302a228c6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.223550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc7687-8e0e-4709-bc82-6302a228c6b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.235934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 39/84] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:59:00 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:00.236984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c2adc-6c52-42d2-a599-8c3e7be27ea9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.303285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc7687-8e0e-4709-bc82-6302a228c6b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:00.304824 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc7687-8e0e-4709-bc82-6302a228c6b6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:00.373801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c2adc-6c52-42d2-a599-8c3e7be27ea9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.415470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4069fc-b260-4434-b2be-29fc5a18c258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.416927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4069fc-b260-4434-b2be-29fc5a18c258 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.417223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4069fc-b260-4434-b2be-29fc5a18c258 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.417504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4069fc-b260-4434-b2be-29fc5a18c258 None admin] PATH_INFO: `/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.418814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4069fc-b260-4434-b2be-29fc5a18c258 None admin] RBAC: Authorizing `identity:get_user(user_id=9aeaa5e28ef143efbeeae1af9fd653f7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:00.420279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4069fc-b260-4434-b2be-29fc5a18c258 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:00.422061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 40/85] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:00 2022] GET /identity/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:00.423870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 46/86] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:00.423982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4069fc-b260-4434-b2be-29fc5a18c258 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.426739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc7687-8e0e-4709-bc82-6302a228c6b6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.440894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:00.456843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:00.550141 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4069fc-b260-4434-b2be-29fc5a18c258 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.560780 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc7687-8e0e-4709-bc82-6302a228c6b6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.596142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08415bc5-3715-4e70-9c8e-655ca5d4bd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.597381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415bc5-3715-4e70-9c8e-655ca5d4bd34 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.598100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415bc5-3715-4e70-9c8e-655ca5d4bd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.598632 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08415bc5-3715-4e70-9c8e-655ca5d4bd34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.600464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08415bc5-3715-4e70-9c8e-655ca5d4bd34 None admin] RBAC: Adding query filter params (role.id=8b1dade745704cf3a2a92b5ac07853b4, scope.project.id=d94efb6a61fb468abaff458dda955336, user.id=9aeaa5e28ef143efbeeae1af9fd653f7) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:00.601014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08415bc5-3715-4e70-9c8e-655ca5d4bd34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:00.604045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08415bc5-3715-4e70-9c8e-655ca5d4bd34 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:00.607344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba55058-fa7a-4a7c-9450-a56ce6992550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.608108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba55058-fa7a-4a7c-9450-a56ce6992550 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.608529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba55058-fa7a-4a7c-9450-a56ce6992550 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.609228 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba55058-fa7a-4a7c-9450-a56ce6992550 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.609708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba55058-fa7a-4a7c-9450-a56ce6992550 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:00.610083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba55058-fa7a-4a7c-9450-a56ce6992550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:00.611603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba55058-fa7a-4a7c-9450-a56ce6992550 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:00.612726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 41/87] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:00 2022] GET /identity/v3/role_assignments?user.id=9aeaa5e28ef143efbeeae1af9fd653f7&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:00.614659 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08415bc5-3715-4e70-9c8e-655ca5d4bd34 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.621804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 47/88] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:00.622886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba55058-fa7a-4a7c-9450-a56ce6992550 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.719368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:00.779606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba55058-fa7a-4a7c-9450-a56ce6992550 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.804103 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:00.822755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08415bc5-3715-4e70-9c8e-655ca5d4bd34 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:00.861412 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d8967-e7fe-4fb8-a0eb-e05260fc580f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.863628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8967-e7fe-4fb8-a0eb-e05260fc580f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.867849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8967-e7fe-4fb8-a0eb-e05260fc580f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.868143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d8967-e7fe-4fb8-a0eb-e05260fc580f None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:00.870965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d8967-e7fe-4fb8-a0eb-e05260fc580f None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:00.872793 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d8967-e7fe-4fb8-a0eb-e05260fc580f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:00.874951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 48/89] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:00 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:00.881388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d8967-e7fe-4fb8-a0eb-e05260fc580f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:00.890249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc99560-d2ae-4bc6-81b4-866707bac5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:00.890926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc99560-d2ae-4bc6-81b4-866707bac5da None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:00.891213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc99560-d2ae-4bc6-81b4-866707bac5da None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:00.891493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc99560-d2ae-4bc6-81b4-866707bac5da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:01.030076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc99560-d2ae-4bc6-81b4-866707bac5da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:01.031539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc99560-d2ae-4bc6-81b4-866707bac5da None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:01.105579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d8967-e7fe-4fb8-a0eb-e05260fc580f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:01.178815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f93732-08a3-479b-864c-b92266130b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:01.180080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93732-08a3-479b-864c-b92266130b81 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:01.180659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93732-08a3-479b-864c-b92266130b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:01.181133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f93732-08a3-479b-864c-b92266130b81 None admin] PATH_INFO: `/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:01.183203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f93732-08a3-479b-864c-b92266130b81 None admin] RBAC: Authorizing `identity:get_user(user_id=9aeaa5e28ef143efbeeae1af9fd653f7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:01.184879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f93732-08a3-479b-864c-b92266130b81 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:01.194179 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 49/90] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:00 2022] GET /identity/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:01.194828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:01.196262 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f93732-08a3-479b-864c-b92266130b81 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:01.206449 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 42/91] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:01.207393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc99560-d2ae-4bc6-81b4-866707bac5da None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:01.222589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:01.321417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc99560-d2ae-4bc6-81b4-866707bac5da None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:01.359893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ec588-7c37-4d0d-aab0-fbff41b96107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:01.360560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ec588-7c37-4d0d-aab0-fbff41b96107 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:01.360849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ec588-7c37-4d0d-aab0-fbff41b96107 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:01.361133 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ec588-7c37-4d0d-aab0-fbff41b96107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:01.430573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:01.440106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ec588-7c37-4d0d-aab0-fbff41b96107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:01.441901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ec588-7c37-4d0d-aab0-fbff41b96107 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:01.448909 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f93732-08a3-479b-864c-b92266130b81 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:01.546094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0b53-af0e-4bd5-a3c1-34901e7ab995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:01.546868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0b53-af0e-4bd5-a3c1-34901e7ab995 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:01.547167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0b53-af0e-4bd5-a3c1-34901e7ab995 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:01.547453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0b53-af0e-4bd5-a3c1-34901e7ab995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:01.548324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e0b53-af0e-4bd5-a3c1-34901e7ab995 None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=d94efb6a61fb468abaff458dda955336, user.id=477dddd95e9e4c9dab1e4c703d6c3e08) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:01.548647 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e0b53-af0e-4bd5-a3c1-34901e7ab995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:01.550111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e0b53-af0e-4bd5-a3c1-34901e7ab995 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:01.551308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 43/92] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:01.551947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ec588-7c37-4d0d-aab0-fbff41b96107 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:01.565178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 50/93] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:01 2022] GET /identity/v3/role_assignments?user.id=477dddd95e9e4c9dab1e4c703d6c3e08&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=57f1335a97b5490cb0853894c2faf62c => generated 259 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:01.566032 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0b53-af0e-4bd5-a3c1-34901e7ab995 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:01.663957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ec588-7c37-4d0d-aab0-fbff41b96107 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:01.704430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72626012-7c8f-4c6e-bbe8-be854de69be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:01.705314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72626012-7c8f-4c6e-bbe8-be854de69be9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:01.705601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72626012-7c8f-4c6e-bbe8-be854de69be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:01.705882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72626012-7c8f-4c6e-bbe8-be854de69be9 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:01.707206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72626012-7c8f-4c6e-bbe8-be854de69be9 None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:01.708750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:01.709744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72626012-7c8f-4c6e-bbe8-be854de69be9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:01.712192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 44/94] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:01 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:01.714587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:01.718818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72626012-7c8f-4c6e-bbe8-be854de69be9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:01.765486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0b53-af0e-4bd5-a3c1-34901e7ab995 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:01.833316 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ab745-8aa1-4dac-83c2-b2f230c6f406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:01.834265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ab745-8aa1-4dac-83c2-b2f230c6f406 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:01.834563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ab745-8aa1-4dac-83c2-b2f230c6f406 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:01.834849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ab745-8aa1-4dac-83c2-b2f230c6f406 None admin] PATH_INFO: `/v3/projects/dc81eb9056e7477db7832643c2fe91de` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:01.839338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ab745-8aa1-4dac-83c2-b2f230c6f406 None admin] RBAC: Authorizing `identity:get_project(project_id=dc81eb9056e7477db7832643c2fe91de)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:01.840817 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ab745-8aa1-4dac-83c2-b2f230c6f406 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:01.853886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 51/95] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:01 2022] GET /identity/v3/projects/dc81eb9056e7477db7832643c2fe91de => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:01.855253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ab745-8aa1-4dac-83c2-b2f230c6f406 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:01.914860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72626012-7c8f-4c6e-bbe8-be854de69be9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:01.980356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4435-6d0f-4518-950a-71861165d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:01.981045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4435-6d0f-4518-950a-71861165d152 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:01.981384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4435-6d0f-4518-950a-71861165d152 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:01.981673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4435-6d0f-4518-950a-71861165d152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:01.982565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4435-6d0f-4518-950a-71861165d152 None admin] RBAC: Adding query filter params (role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7, scope.project.id=d94efb6a61fb468abaff458dda955336, user.id=9aeaa5e28ef143efbeeae1af9fd653f7) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:01.982891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4435-6d0f-4518-950a-71861165d152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:01.984382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4435-6d0f-4518-950a-71861165d152 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:01.997214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 45/96] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:01 2022] GET /identity/v3/role_assignments?user.id=9aeaa5e28ef143efbeeae1af9fd653f7&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:02.023818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ab745-8aa1-4dac-83c2-b2f230c6f406 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:02.077580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b294b07-04dc-4598-8bea-ba6576007ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:02.078297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b294b07-04dc-4598-8bea-ba6576007ecd None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:02.078589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b294b07-04dc-4598-8bea-ba6576007ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:02.078870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b294b07-04dc-4598-8bea-ba6576007ecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:02.079734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b294b07-04dc-4598-8bea-ba6576007ecd None admin] RBAC: Adding query filter params (role.id=8b1dade745704cf3a2a92b5ac07853b4, scope.project.id=dc81eb9056e7477db7832643c2fe91de, user.id=9aeaa5e28ef143efbeeae1af9fd653f7) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:02.080051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b294b07-04dc-4598-8bea-ba6576007ecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:02.081514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b294b07-04dc-4598-8bea-ba6576007ecd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:02.087949 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 52/97] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:01 2022] GET /identity/v3/role_assignments?user.id=9aeaa5e28ef143efbeeae1af9fd653f7&scope.project.id=dc81eb9056e7477db7832643c2fe91de&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:03.011519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9eed3-7e3e-406c-acaa-afa202d7e932 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.012038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9eed3-7e3e-406c-acaa-afa202d7e932 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.012119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9eed3-7e3e-406c-acaa-afa202d7e932 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.013669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 46/98] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:03.018835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9bc43-23be-4cbb-9e2f-64efea7a95a5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.019282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9bc43-23be-4cbb-9e2f-64efea7a95a5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.019459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9bc43-23be-4cbb-9e2f-64efea7a95a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.038206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:03.047677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-18b9bc43-23be-4cbb-9e2f-64efea7a95a5 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:03.048921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-18b9bc43-23be-4cbb-9e2f-64efea7a95a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:03.095714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69115d99-cc62-4dc5-b749-9226054bb106 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.096137 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69115d99-cc62-4dc5-b749-9226054bb106 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.096431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69115d99-cc62-4dc5-b749-9226054bb106 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.098084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 47/99] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:03.110509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163382-c538-41b0-be13-c211bc249c40 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.110802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163382-c538-41b0-be13-c211bc249c40 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.111089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163382-c538-41b0-be13-c211bc249c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.129339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 53/100] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:03.147401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-31163382-c538-41b0-be13-c211bc249c40 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:03.148926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-31163382-c538-41b0-be13-c211bc249c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:03.179400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:03.204473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9bc43-23be-4cbb-9e2f-64efea7a95a5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:03.304404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 48/101] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:03.339345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31163382-c538-41b0-be13-c211bc249c40 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:03.384207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9bc43-23be-4cbb-9e2f-64efea7a95a5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:03.428319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b626d4-fc72-45be-85a8-0321f1ddafb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:03.429144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b626d4-fc72-45be-85a8-0321f1ddafb0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.429435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b626d4-fc72-45be-85a8-0321f1ddafb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.429713 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b626d4-fc72-45be-85a8-0321f1ddafb0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.436705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:03.450504 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b626d4-fc72-45be-85a8-0321f1ddafb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-61b626d4-fc72-45be-85a8-0321f1ddafb0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:03.464674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:03.465577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:03.466388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 54/102] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:03.469216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2cc3-a53f-4269-aa46-46048a0503ff None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.469517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2cc3-a53f-4269-aa46-46048a0503ff None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.469800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2cc3-a53f-4269-aa46-46048a0503ff None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.471266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 55/103] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:03.473541 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2cc3-a53f-4269-aa46-46048a0503ff None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:03.552202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31163382-c538-41b0-be13-c211bc249c40 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:03.613692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad78e9-d44e-435f-a2b5-e09959a219ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:03.614447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad78e9-d44e-435f-a2b5-e09959a219ea None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.614733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad78e9-d44e-435f-a2b5-e09959a219ea None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.615013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad78e9-d44e-435f-a2b5-e09959a219ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.640603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad78e9-d44e-435f-a2b5-e09959a219ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-00ad78e9-d44e-435f-a2b5-e09959a219ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:03.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:03.654347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:03.655131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 49/104] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:03.656544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc8c42-211f-4ef2-a5d7-998432373102 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.656544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc8c42-211f-4ef2-a5d7-998432373102 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.656544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc8c42-211f-4ef2-a5d7-998432373102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.688712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2cc3-a53f-4269-aa46-46048a0503ff None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:03.699223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a0bc8c42-211f-4ef2-a5d7-998432373102 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:03.700492 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a0bc8c42-211f-4ef2-a5d7-998432373102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:03.720530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:03.730985 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d6248-0d9f-4ee8-b5af-c048943d61fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:03.731687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d6248-0d9f-4ee8-b5af-c048943d61fe None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.731980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d6248-0d9f-4ee8-b5af-c048943d61fe None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.732542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d6248-0d9f-4ee8-b5af-c048943d61fe None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.733332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d6248-0d9f-4ee8-b5af-c048943d61fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:03.733650 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d6248-0d9f-4ee8-b5af-c048943d61fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:03.735826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d6248-0d9f-4ee8-b5af-c048943d61fe None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:03.748232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 56/105] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:03.748889 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d6248-0d9f-4ee8-b5af-c048943d61fe None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:03.820627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:03.881141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d6248-0d9f-4ee8-b5af-c048943d61fe None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:03.892136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 50/106] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:03.893399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc8c42-211f-4ef2-a5d7-998432373102 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:03.936545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8576015-7b04-43d6-bdc9-f4e5b689ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:03.937241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8576015-7b04-43d6-bdc9-f4e5b689ffae None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:03.937528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8576015-7b04-43d6-bdc9-f4e5b689ffae None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:03.937806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8576015-7b04-43d6-bdc9-f4e5b689ffae None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:03.938607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8576015-7b04-43d6-bdc9-f4e5b689ffae None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:03.938922 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8576015-7b04-43d6-bdc9-f4e5b689ffae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:03.940331 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8576015-7b04-43d6-bdc9-f4e5b689ffae None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:03.964527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 57/107] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:03.965241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8576015-7b04-43d6-bdc9-f4e5b689ffae None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:04.089712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8576015-7b04-43d6-bdc9-f4e5b689ffae None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:04.115843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:04.128862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae67d-8b64-4a6e-b8d3-55e9e9f341ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:04.129806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae67d-8b64-4a6e-b8d3-55e9e9f341ce None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.130100 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae67d-8b64-4a6e-b8d3-55e9e9f341ce None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.130417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dae67d-8b64-4a6e-b8d3-55e9e9f341ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.131685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dae67d-8b64-4a6e-b8d3-55e9e9f341ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:04.133367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dae67d-8b64-4a6e-b8d3-55e9e9f341ce None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.135687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 58/108] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:04.136479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae67d-8b64-4a6e-b8d3-55e9e9f341ce None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:04.167478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc8c42-211f-4ef2-a5d7-998432373102 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:04.204370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fbf27-4e4c-4184-a4b0-ae5a0515cb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:04.205590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fbf27-4e4c-4184-a4b0-ae5a0515cb64 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.206076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fbf27-4e4c-4184-a4b0-ae5a0515cb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.206581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fbf27-4e4c-4184-a4b0-ae5a0515cb64 None admin] PATH_INFO: `/v3/users/4c8e1dd3b1284e1fb7020582f65287ba` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.221195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fbf27-4e4c-4184-a4b0-ae5a0515cb64 None admin] RBAC: Authorizing `identity:get_user(user_id=4c8e1dd3b1284e1fb7020582f65287ba)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:04.223022 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083fbf27-4e4c-4184-a4b0-ae5a0515cb64 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.229899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 51/109] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:03 2022] GET /identity/v3/users/4c8e1dd3b1284e1fb7020582f65287ba => generated 289 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:04.230981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fbf27-4e4c-4184-a4b0-ae5a0515cb64 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:04.246500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:04.273644 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dae67d-8b64-4a6e-b8d3-55e9e9f341ce None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:04.310372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122f8c7-c2cf-426d-b8a5-93fbcc20265b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:04.311274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122f8c7-c2cf-426d-b8a5-93fbcc20265b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.311628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122f8c7-c2cf-426d-b8a5-93fbcc20265b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.311916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122f8c7-c2cf-426d-b8a5-93fbcc20265b None admin] PATH_INFO: `/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.313215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122f8c7-c2cf-426d-b8a5-93fbcc20265b None admin] RBAC: Authorizing `identity:get_user(user_id=9aeaa5e28ef143efbeeae1af9fd653f7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:04.314760 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122f8c7-c2cf-426d-b8a5-93fbcc20265b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.316437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 59/110] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:04 2022] GET /identity/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:04.317679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386eea1-c6c8-43d5-a984-f9560791c870 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.317994 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386eea1-c6c8-43d5-a984-f9560791c870 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.322917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386eea1-c6c8-43d5-a984-f9560791c870 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.324428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 60/111] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:04.325385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386eea1-c6c8-43d5-a984-f9560791c870 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:04.341636 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fbf27-4e4c-4184-a4b0-ae5a0515cb64 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:04.379967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb8fbb-475a-4f0e-bb5c-3f4488712e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:04.381102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8fbb-475a-4f0e-bb5c-3f4488712e18 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.381587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8fbb-475a-4f0e-bb5c-3f4488712e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.382241 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8fbb-475a-4f0e-bb5c-3f4488712e18 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.383282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb8fbb-475a-4f0e-bb5c-3f4488712e18 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:04.385632 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb8fbb-475a-4f0e-bb5c-3f4488712e18 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.395075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:04.419261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 52/112] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 13:59:04 2022] POST /identity/v3/projects => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:04.420704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb8fbb-475a-4f0e-bb5c-3f4488712e18 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:04.453813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386eea1-c6c8-43d5-a984-f9560791c870 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:04.485593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:04.501505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87989d67-ff92-4b84-a24b-36c6ddce7499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:04.502218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87989d67-ff92-4b84-a24b-36c6ddce7499 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.502520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87989d67-ff92-4b84-a24b-36c6ddce7499 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.502807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87989d67-ff92-4b84-a24b-36c6ddce7499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.572036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb8fbb-475a-4f0e-bb5c-3f4488712e18 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:04.637512 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87989d67-ff92-4b84-a24b-36c6ddce7499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:04.639209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87989d67-ff92-4b84-a24b-36c6ddce7499 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.648323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc95729-59e8-46a0-b5e5-399bfa417658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:04.649213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95729-59e8-46a0-b5e5-399bfa417658 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.649499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95729-59e8-46a0-b5e5-399bfa417658 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.649779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95729-59e8-46a0-b5e5-399bfa417658 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.655017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc95729-59e8-46a0-b5e5-399bfa417658 None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:04.657309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc95729-59e8-46a0-b5e5-399bfa417658 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.659742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 53/113] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:04 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:04.662882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048b10-993e-4b22-aa2d-47c382034daa None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.663407 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048b10-993e-4b22-aa2d-47c382034daa None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.663905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db048b10-993e-4b22-aa2d-47c382034daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.685393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-db048b10-993e-4b22-aa2d-47c382034daa None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:04.687003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-db048b10-993e-4b22-aa2d-47c382034daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:04.709100 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:04.772374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 61/114] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:04.773882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87989d67-ff92-4b84-a24b-36c6ddce7499 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:04.778797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 54/115] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:04.779507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db048b10-993e-4b22-aa2d-47c382034daa None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:04.865336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:04.904130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87989d67-ff92-4b84-a24b-36c6ddce7499 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:04.926339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db048b10-993e-4b22-aa2d-47c382034daa None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:04.958023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e9d45-da01-46c6-8148-a53b0489c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:04.959071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9d45-da01-46c6-8148-a53b0489c70c None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.959357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9d45-da01-46c6-8148-a53b0489c70c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.959644 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e9d45-da01-46c6-8148-a53b0489c70c None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336/users/9aeaa5e28ef143efbeeae1af9fd653f7/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.962064 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e9d45-da01-46c6-8148-a53b0489c70c None admin] RBAC: Authorizing `identity:create_grant(project_id=d94efb6a61fb468abaff458dda955336, user_id=9aeaa5e28ef143efbeeae1af9fd653f7, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:04.964006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e9d45-da01-46c6-8148-a53b0489c70c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.969020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903650df-1334-40cc-9cb4-29742b2e4819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:04.970194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903650df-1334-40cc-9cb4-29742b2e4819 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.971084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903650df-1334-40cc-9cb4-29742b2e4819 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.971451 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903650df-1334-40cc-9cb4-29742b2e4819 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.973961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903650df-1334-40cc-9cb4-29742b2e4819 None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:04.975507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903650df-1334-40cc-9cb4-29742b2e4819 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:04.982533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 55/116] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:04 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:04.982533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903650df-1334-40cc-9cb4-29742b2e4819 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:04.989532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 62/117] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 13:59:04 2022] PUT /identity/v3/projects/d94efb6a61fb468abaff458dda955336/users/9aeaa5e28ef143efbeeae1af9fd653f7/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:04.990747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087edf3a-a29f-4057-9c40-b7ee73425804 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:04.990979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087edf3a-a29f-4057-9c40-b7ee73425804 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:04.992025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087edf3a-a29f-4057-9c40-b7ee73425804 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:04.992771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 63/118] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:04.993279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087edf3a-a29f-4057-9c40-b7ee73425804 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:05.030822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:05.127808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903650df-1334-40cc-9cb4-29742b2e4819 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:05.152293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:05.161548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087edf3a-a29f-4057-9c40-b7ee73425804 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:05.174106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3deee7-5499-4306-885d-0afeaf0b78d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:05.174970 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3deee7-5499-4306-885d-0afeaf0b78d7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:05.175643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3deee7-5499-4306-885d-0afeaf0b78d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:05.175643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3deee7-5499-4306-885d-0afeaf0b78d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:05.188598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3deee7-5499-4306-885d-0afeaf0b78d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-ad3deee7-5499-4306-885d-0afeaf0b78d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:05.199064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:05.199985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:05.200757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 56/119] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:59:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:05.201786 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904db7-26c0-449d-a744-be88de801cd9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:05.206298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904db7-26c0-449d-a744-be88de801cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:05.206298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904db7-26c0-449d-a744-be88de801cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:05.216346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaaf0e-4985-46de-b17a-2acad40f416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:05.218457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaaf0e-4985-46de-b17a-2acad40f416e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:05.218457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaaf0e-4985-46de-b17a-2acad40f416e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:05.218457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaaf0e-4985-46de-b17a-2acad40f416e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:05.221742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaaf0e-4985-46de-b17a-2acad40f416e None admin] RBAC: Adding query filter params (role.id=07eba1cca2a34e7bbde6d6a82772b4ae, scope.project.id=d94efb6a61fb468abaff458dda955336, user.id=4c8e1dd3b1284e1fb7020582f65287ba) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:05.222100 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaaf0e-4985-46de-b17a-2acad40f416e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:05.223583 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaaf0e-4985-46de-b17a-2acad40f416e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:05.227793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4e904db7-26c0-449d-a744-be88de801cd9 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:05.229733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4e904db7-26c0-449d-a744-be88de801cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:05.236895 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 64/120] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:04 2022] GET /identity/v3/role_assignments?user.id=4c8e1dd3b1284e1fb7020582f65287ba&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=07eba1cca2a34e7bbde6d6a82772b4ae => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:05.238092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aeb80-7aef-4efb-a88e-e43c7d6b262f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:05.238416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aeb80-7aef-4efb-a88e-e43c7d6b262f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:05.238703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aeb80-7aef-4efb-a88e-e43c7d6b262f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:05.240030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 65/121] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:05.240753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aeb80-7aef-4efb-a88e-e43c7d6b262f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:05.321489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 57/122] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:05.323500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e511-54cf-4ac8-b0c9-d184de1be576 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:05.323795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e511-54cf-4ac8-b0c9-d184de1be576 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:05.324530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38e511-54cf-4ac8-b0c9-d184de1be576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:05.347135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fc38e511-54cf-4ac8-b0c9-d184de1be576 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:05.348848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fc38e511-54cf-4ac8-b0c9-d184de1be576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:05.352370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:05.410309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aeb80-7aef-4efb-a88e-e43c7d6b262f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:05.435813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 58/123] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:05.436975 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38e511-54cf-4ac8-b0c9-d184de1be576 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:05.485789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce9e03-1ab0-4c7e-adb5-7f28d25df504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:05.486841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9e03-1ab0-4c7e-adb5-7f28d25df504 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:05.487328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9e03-1ab0-4c7e-adb5-7f28d25df504 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:05.488233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce9e03-1ab0-4c7e-adb5-7f28d25df504 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:05.489204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce9e03-1ab0-4c7e-adb5-7f28d25df504 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:05.489760 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce9e03-1ab0-4c7e-adb5-7f28d25df504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:05.491662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce9e03-1ab0-4c7e-adb5-7f28d25df504 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:05.502680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 66/124] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:05.503820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce9e03-1ab0-4c7e-adb5-7f28d25df504 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:05.524281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:05.642094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38e511-54cf-4ac8-b0c9-d184de1be576 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:05.653006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce9e03-1ab0-4c7e-adb5-7f28d25df504 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:05.703088 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cd369-63ac-4e00-a4e5-2b9f4a9d9aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:05.703836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd369-63ac-4e00-a4e5-2b9f4a9d9aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:05.704130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd369-63ac-4e00-a4e5-2b9f4a9d9aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:05.704415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd369-63ac-4e00-a4e5-2b9f4a9d9aa0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:05.721599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f11dbc-8dba-47e8-bbfc-04cb6821ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:05.722450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f11dbc-8dba-47e8-bbfc-04cb6821ede9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:05.722738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f11dbc-8dba-47e8-bbfc-04cb6821ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:05.723020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f11dbc-8dba-47e8-bbfc-04cb6821ede9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:05.729417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cd369-63ac-4e00-a4e5-2b9f4a9d9aa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c16cd369-63ac-4e00-a4e5-2b9f4a9d9aa0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:05.740326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:05.741246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:05.742048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 59/125] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:05.742725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cd369-63ac-4e00-a4e5-2b9f4a9d9aa0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:05.750193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f11dbc-8dba-47e8-bbfc-04cb6821ede9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-03f11dbc-8dba-47e8-bbfc-04cb6821ede9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:05.761630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:05.762552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:05.763326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:05.764742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 67/126] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:05.767475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f11dbc-8dba-47e8-bbfc-04cb6821ede9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:05.774272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:05.935902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:05.940118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cd369-63ac-4e00-a4e5-2b9f4a9d9aa0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:05.959973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f11dbc-8dba-47e8-bbfc-04cb6821ede9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:06.012255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c239e9-b24f-4619-87f6-06b921503b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:06.012946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c239e9-b24f-4619-87f6-06b921503b40 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:06.013268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c239e9-b24f-4619-87f6-06b921503b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:06.013551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c239e9-b24f-4619-87f6-06b921503b40 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:06.014351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c239e9-b24f-4619-87f6-06b921503b40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:06.014802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c239e9-b24f-4619-87f6-06b921503b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:06.016312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c239e9-b24f-4619-87f6-06b921503b40 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:06.023415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc15f21-1aac-48df-b19c-f4ca532ae0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:06.024307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc15f21-1aac-48df-b19c-f4ca532ae0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:06.024593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc15f21-1aac-48df-b19c-f4ca532ae0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:06.024875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc15f21-1aac-48df-b19c-f4ca532ae0e1 None admin] PATH_INFO: `/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:06.026795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 68/127] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:06.027754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c239e9-b24f-4619-87f6-06b921503b40 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:06.031189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc15f21-1aac-48df-b19c-f4ca532ae0e1 None admin] RBAC: Authorizing `identity:get_user(user_id=477dddd95e9e4c9dab1e4c703d6c3e08)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:06.032693 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc15f21-1aac-48df-b19c-f4ca532ae0e1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:06.034781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 60/128] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:05 2022] GET /identity/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08 => generated 247 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:06.036879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc15f21-1aac-48df-b19c-f4ca532ae0e1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:06.158553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:06.200819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c239e9-b24f-4619-87f6-06b921503b40 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:06.237474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878b6b-a248-4a68-bd25-5a78ce83e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:06.238193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878b6b-a248-4a68-bd25-5a78ce83e705 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:06.238511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878b6b-a248-4a68-bd25-5a78ce83e705 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:06.238882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878b6b-a248-4a68-bd25-5a78ce83e705 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:06.240205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5878b6b-a248-4a68-bd25-5a78ce83e705 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:06.240531 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5878b6b-a248-4a68-bd25-5a78ce83e705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:06.242473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5878b6b-a248-4a68-bd25-5a78ce83e705 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:06.253164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 69/129] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:06.254635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878b6b-a248-4a68-bd25-5a78ce83e705 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:06.308712 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc15f21-1aac-48df-b19c-f4ca532ae0e1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:06.370963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878b6b-a248-4a68-bd25-5a78ce83e705 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:06.376984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3140e6-0d89-4184-95ac-c3a0c8d0e3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:06.378149 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3140e6-0d89-4184-95ac-c3a0c8d0e3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:06.378663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3140e6-0d89-4184-95ac-c3a0c8d0e3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:06.379169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3140e6-0d89-4184-95ac-c3a0c8d0e3e7 None admin] PATH_INFO: `/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:06.380641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3140e6-0d89-4184-95ac-c3a0c8d0e3e7 None admin] RBAC: Authorizing `identity:get_user(user_id=9aeaa5e28ef143efbeeae1af9fd653f7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:06.382472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3140e6-0d89-4184-95ac-c3a0c8d0e3e7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:06.384511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 61/130] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:06 2022] GET /identity/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7 => generated 275 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:06.386327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3140e6-0d89-4184-95ac-c3a0c8d0e3e7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:06.410899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:06.424304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f20eb9-19d1-4e7d-a13c-c074a21dca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:06.425217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f20eb9-19d1-4e7d-a13c-c074a21dca5c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:06.425514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f20eb9-19d1-4e7d-a13c-c074a21dca5c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:06.425804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f20eb9-19d1-4e7d-a13c-c074a21dca5c None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:06.428292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f20eb9-19d1-4e7d-a13c-c074a21dca5c None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:06.429842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f20eb9-19d1-4e7d-a13c-c074a21dca5c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:06.434035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 70/131] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:06 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:06.434035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f20eb9-19d1-4e7d-a13c-c074a21dca5c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:06.464824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:06.557876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f20eb9-19d1-4e7d-a13c-c074a21dca5c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:06.604939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a255e8d-3747-40d6-85d7-ebf14153e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:06.606183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a255e8d-3747-40d6-85d7-ebf14153e237 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:06.606690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a255e8d-3747-40d6-85d7-ebf14153e237 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:06.607171 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a255e8d-3747-40d6-85d7-ebf14153e237 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:06.610055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a255e8d-3747-40d6-85d7-ebf14153e237 None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:06.611854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a255e8d-3747-40d6-85d7-ebf14153e237 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:06.622274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 71/132] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:06 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:06.623436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a255e8d-3747-40d6-85d7-ebf14153e237 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:06.667596 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3140e6-0d89-4184-95ac-c3a0c8d0e3e7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:06.721731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:06.757929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a255e8d-3747-40d6-85d7-ebf14153e237 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:06.798091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5c340-8000-47b1-835e-3cef0c44b5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:06.799630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5c340-8000-47b1-835e-3cef0c44b5fc None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:06.800266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5c340-8000-47b1-835e-3cef0c44b5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:06.801002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5c340-8000-47b1-835e-3cef0c44b5fc None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336/users/477dddd95e9e4c9dab1e4c703d6c3e08/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:06.803297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5c340-8000-47b1-835e-3cef0c44b5fc None admin] RBAC: Authorizing `identity:create_grant(project_id=d94efb6a61fb468abaff458dda955336, user_id=477dddd95e9e4c9dab1e4c703d6c3e08, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:06.804974 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5c340-8000-47b1-835e-3cef0c44b5fc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:06.824060 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994db1ca-436e-46cb-9ace-b2d0228c47a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:06.826027 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994db1ca-436e-46cb-9ace-b2d0228c47a9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:06.826945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994db1ca-436e-46cb-9ace-b2d0228c47a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:06.828035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994db1ca-436e-46cb-9ace-b2d0228c47a9 None admin] PATH_INFO: `/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:06.830783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994db1ca-436e-46cb-9ace-b2d0228c47a9 None admin] RBAC: Authorizing `identity:get_user(user_id=9aeaa5e28ef143efbeeae1af9fd653f7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:06.833699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 72/133] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 13:59:06 2022] PUT /identity/v3/projects/d94efb6a61fb468abaff458dda955336/users/477dddd95e9e4c9dab1e4c703d6c3e08/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:06.835460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5c340-8000-47b1-835e-3cef0c44b5fc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:06.835990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994db1ca-436e-46cb-9ace-b2d0228c47a9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:06.840813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 62/134] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:06 2022] GET /identity/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7 => generated 275 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:06.846665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994db1ca-436e-46cb-9ace-b2d0228c47a9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:06.988066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5c340-8000-47b1-835e-3cef0c44b5fc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:07.018629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:07.029472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9481955-f9f1-444a-803e-0da3e3662458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:07.030831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9481955-f9f1-444a-803e-0da3e3662458 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.031321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9481955-f9f1-444a-803e-0da3e3662458 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.031804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9481955-f9f1-444a-803e-0da3e3662458 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336/users/9aeaa5e28ef143efbeeae1af9fd653f7/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.034465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9481955-f9f1-444a-803e-0da3e3662458 None admin] RBAC: Authorizing `identity:create_grant(project_id=d94efb6a61fb468abaff458dda955336, user_id=9aeaa5e28ef143efbeeae1af9fd653f7, role_id=a9fb1d2d70d24a29a0fad5800c9ea0f7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:07.036283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9481955-f9f1-444a-803e-0da3e3662458 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:07.053647 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 73/135] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 13:59:06 2022] PUT /identity/v3/projects/d94efb6a61fb468abaff458dda955336/users/9aeaa5e28ef143efbeeae1af9fd653f7/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:07.058023 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994db1ca-436e-46cb-9ace-b2d0228c47a9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:07.060518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:07.118675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8b610-a4a8-4a30-9ca8-6f35b1ab7f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:07.120075 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8b610-a4a8-4a30-9ca8-6f35b1ab7f3c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.120375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8b610-a4a8-4a30-9ca8-6f35b1ab7f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.120686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8b610-a4a8-4a30-9ca8-6f35b1ab7f3c None admin] PATH_INFO: `/v3/projects/dc81eb9056e7477db7832643c2fe91de` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.127187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8b610-a4a8-4a30-9ca8-6f35b1ab7f3c None admin] RBAC: Authorizing `identity:get_project(project_id=dc81eb9056e7477db7832643c2fe91de)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:07.128709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8b610-a4a8-4a30-9ca8-6f35b1ab7f3c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:07.130583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 63/136] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:06 2022] GET /identity/v3/projects/dc81eb9056e7477db7832643c2fe91de => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:07.136672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9481955-f9f1-444a-803e-0da3e3662458 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:07.160554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8534777-3c4b-4e40-8ab4-175782c2dbd7 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.161042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8534777-3c4b-4e40-8ab4-175782c2dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.161152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8534777-3c4b-4e40-8ab4-175782c2dbd7 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.162791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 64/137] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:07.185441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7ef9-4461-4430-a104-e7c70c0ef1db None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.185767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7ef9-4461-4430-a104-e7c70c0ef1db None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.186021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7ef9-4461-4430-a104-e7c70c0ef1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.223457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-709b7ef9-4461-4430-a104-e7c70c0ef1db None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:07.224569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-709b7ef9-4461-4430-a104-e7c70c0ef1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:07.276122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9481955-f9f1-444a-803e-0da3e3662458 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:07.315380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d651bb-a171-4174-afb3-f9de77e9f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:07.316770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d651bb-a171-4174-afb3-f9de77e9f39f None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.317250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d651bb-a171-4174-afb3-f9de77e9f39f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.317739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d651bb-a171-4174-afb3-f9de77e9f39f None admin] PATH_INFO: `/v3/projects/dc81eb9056e7477db7832643c2fe91de/users/9aeaa5e28ef143efbeeae1af9fd653f7/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.321714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d651bb-a171-4174-afb3-f9de77e9f39f None admin] RBAC: Authorizing `identity:create_grant(project_id=dc81eb9056e7477db7832643c2fe91de, user_id=9aeaa5e28ef143efbeeae1af9fd653f7, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:07.324252 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d651bb-a171-4174-afb3-f9de77e9f39f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:07.341092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 74/138] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 13:59:07 2022] PUT /identity/v3/projects/dc81eb9056e7477db7832643c2fe91de/users/9aeaa5e28ef143efbeeae1af9fd653f7/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:07.355642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 65/139] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:07.397106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d651bb-a171-4174-afb3-f9de77e9f39f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:07.456350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:07.531578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d651bb-a171-4174-afb3-f9de77e9f39f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:07.575767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373d82d-2129-4240-a876-88d5fecd3b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:07.576606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d82d-2129-4240-a876-88d5fecd3b7a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.576893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d82d-2129-4240-a876-88d5fecd3b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.577169 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373d82d-2129-4240-a876-88d5fecd3b7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.578448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373d82d-2129-4240-a876-88d5fecd3b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:07.580069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373d82d-2129-4240-a876-88d5fecd3b7a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:07.581762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 75/140] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:07.591270 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b7ef9-4461-4430-a104-e7c70c0ef1db None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:07.742297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b7ef9-4461-4430-a104-e7c70c0ef1db None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:07.744222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:07.766723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34522571-b628-4564-9200-0c70fdb2ffed None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.767071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34522571-b628-4564-9200-0c70fdb2ffed None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.767356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34522571-b628-4564-9200-0c70fdb2ffed None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.768738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 76/141] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:07.774279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ebb05-9cff-4fba-9f87-e7bb04c0a60c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.774569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ebb05-9cff-4fba-9f87-e7bb04c0a60c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.774846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ebb05-9cff-4fba-9f87-e7bb04c0a60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.800148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c53ebb05-9cff-4fba-9f87-e7bb04c0a60c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:07.802688 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c53ebb05-9cff-4fba-9f87-e7bb04c0a60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:07.818390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdfd33-50e2-4179-93c5-68371c2b6079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:07.819089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdfd33-50e2-4179-93c5-68371c2b6079 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:07.819373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdfd33-50e2-4179-93c5-68371c2b6079 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:07.819653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdfd33-50e2-4179-93c5-68371c2b6079 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:07.820380 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdfd33-50e2-4179-93c5-68371c2b6079 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:07.821865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdfd33-50e2-4179-93c5-68371c2b6079 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:07.849571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 66/142] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:59:07 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:07.967443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 77/143] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:08.006770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdfd33-50e2-4179-93c5-68371c2b6079 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:08.138607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdfd33-50e2-4179-93c5-68371c2b6079 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:08.175543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08941d70-0f3f-48cd-8810-a7aa6b13f2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:08.176361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941d70-0f3f-48cd-8810-a7aa6b13f2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.176645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941d70-0f3f-48cd-8810-a7aa6b13f2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.176922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941d70-0f3f-48cd-8810-a7aa6b13f2d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:08.188182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08941d70-0f3f-48cd-8810-a7aa6b13f2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-08941d70-0f3f-48cd-8810-a7aa6b13f2d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:08.196053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:08.197452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:08.198372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 67/144] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:08.212433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ebb05-9cff-4fba-9f87-e7bb04c0a60c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:08.213642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713dcbd-abf6-4498-b49d-23c0c7c0443c None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.214068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713dcbd-abf6-4498-b49d-23c0c7c0443c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.214407 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713dcbd-abf6-4498-b49d-23c0c7c0443c None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:08.216087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 68/145] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:08.222583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8855a-834a-4ec6-a80d-a210c18a91c2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.222877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8855a-834a-4ec6-a80d-a210c18a91c2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.223161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8855a-834a-4ec6-a80d-a210c18a91c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:08.242752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-90c8855a-834a-4ec6-a80d-a210c18a91c2 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:08.244514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-90c8855a-834a-4ec6-a80d-a210c18a91c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:08.261321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:08.325635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 69/146] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:08.342313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:08.370507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8855a-834a-4ec6-a80d-a210c18a91c2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:08.469652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ebb05-9cff-4fba-9f87-e7bb04c0a60c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:08.544455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ff39a-6f56-4e21-95b2-8a2cbdbaf674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:08.545746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ff39a-6f56-4e21-95b2-8a2cbdbaf674 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.546210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ff39a-6f56-4e21-95b2-8a2cbdbaf674 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.546782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ff39a-6f56-4e21-95b2-8a2cbdbaf674 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:08.547693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ff39a-6f56-4e21-95b2-8a2cbdbaf674 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:08.548192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ff39a-6f56-4e21-95b2-8a2cbdbaf674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:08.549840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ff39a-6f56-4e21-95b2-8a2cbdbaf674 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:08.564073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 78/147] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:08.569969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ff39a-6f56-4e21-95b2-8a2cbdbaf674 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:08.595330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8855a-834a-4ec6-a80d-a210c18a91c2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:08.659238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f3be9-63d2-4cbc-8b47-a06cecd7a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:08.659742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3be9-63d2-4cbc-8b47-a06cecd7a7dc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.660033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3be9-63d2-4cbc-8b47-a06cecd7a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.660318 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3be9-63d2-4cbc-8b47-a06cecd7a7dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:08.675679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f3be9-63d2-4cbc-8b47-a06cecd7a7dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-fd3f3be9-63d2-4cbc-8b47-a06cecd7a7dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:08.688195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:08.689113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:08.690335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 70/148] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:08.695369 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f3be9-63d2-4cbc-8b47-a06cecd7a7dc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:08.700831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ff39a-6f56-4e21-95b2-8a2cbdbaf674 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:08.702721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:08.715326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:08.751051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdc065-7dcc-4826-ab12-97f45586c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:08.752362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdc065-7dcc-4826-ab12-97f45586c3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.752879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdc065-7dcc-4826-ab12-97f45586c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.753365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdc065-7dcc-4826-ab12-97f45586c3a3 None admin] PATH_INFO: `/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:08.754891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdc065-7dcc-4826-ab12-97f45586c3a3 None admin] RBAC: Authorizing `identity:get_user(user_id=9aeaa5e28ef143efbeeae1af9fd653f7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:08.756618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdc065-7dcc-4826-ab12-97f45586c3a3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:08.758618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 79/149] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:08 2022] GET /identity/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:08.764304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdc065-7dcc-4826-ab12-97f45586c3a3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:08.820778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f3be9-63d2-4cbc-8b47-a06cecd7a7dc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:08.865125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36424be1-ed80-407b-a879-276f5928769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:08.865819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424be1-ed80-407b-a879-276f5928769d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.866107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424be1-ed80-407b-a879-276f5928769d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.866425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424be1-ed80-407b-a879-276f5928769d None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:08.867223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36424be1-ed80-407b-a879-276f5928769d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:08.867536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36424be1-ed80-407b-a879-276f5928769d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:08.869836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36424be1-ed80-407b-a879-276f5928769d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:08.879472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 71/150] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:08.885339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36424be1-ed80-407b-a879-276f5928769d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:08.912116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdc065-7dcc-4826-ab12-97f45586c3a3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:08.970765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:08.971249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cef9d-5952-41b4-bfce-17ce702d8cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:08.972277 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cef9d-5952-41b4-bfce-17ce702d8cda None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:08.972917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cef9d-5952-41b4-bfce-17ce702d8cda None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:08.973405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cef9d-5952-41b4-bfce-17ce702d8cda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:09.007015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36424be1-ed80-407b-a879-276f5928769d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:09.032263 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:09.047445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cc8fb-26db-4727-b9d7-ea25c20ce7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:09.048611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cc8fb-26db-4727-b9d7-ea25c20ce7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:09.049039 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cc8fb-26db-4727-b9d7-ea25c20ce7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:09.049457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cc8fb-26db-4727-b9d7-ea25c20ce7c5 None admin] PATH_INFO: `/v3/users/4c8e1dd3b1284e1fb7020582f65287ba` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:09.051881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cc8fb-26db-4727-b9d7-ea25c20ce7c5 None admin] RBAC: Authorizing `identity:get_user(user_id=4c8e1dd3b1284e1fb7020582f65287ba)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:09.053593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cc8fb-26db-4727-b9d7-ea25c20ce7c5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:09.055848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 72/151] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:08 2022] GET /identity/v3/users/4c8e1dd3b1284e1fb7020582f65287ba => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:09.062384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cc8fb-26db-4727-b9d7-ea25c20ce7c5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:09.075461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cef9d-5952-41b4-bfce-17ce702d8cda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:09.076848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cef9d-5952-41b4-bfce-17ce702d8cda None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:09.176762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cc8fb-26db-4727-b9d7-ea25c20ce7c5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:09.220387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 80/152] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 13:59:09.225524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe006960-dab3-447d-9f78-c8f70b9d2234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:09.226458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cef9d-5952-41b4-bfce-17ce702d8cda None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:09.226926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe006960-dab3-447d-9f78-c8f70b9d2234 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:09.227433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe006960-dab3-447d-9f78-c8f70b9d2234 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:09.227911 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe006960-dab3-447d-9f78-c8f70b9d2234 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:09.231153 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe006960-dab3-447d-9f78-c8f70b9d2234 None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:09.232881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe006960-dab3-447d-9f78-c8f70b9d2234 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:09.234948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 73/153] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:09 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:09.241075 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe006960-dab3-447d-9f78-c8f70b9d2234 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:09.278710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:09.332203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:09.365508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe006960-dab3-447d-9f78-c8f70b9d2234 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:09.381687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cef9d-5952-41b4-bfce-17ce702d8cda None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:09.413029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8341c54-70e8-4fa3-8290-1d81caa9cc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:09.414655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8341c54-70e8-4fa3-8290-1d81caa9cc1a None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:09.415146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8341c54-70e8-4fa3-8290-1d81caa9cc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:09.416279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8341c54-70e8-4fa3-8290-1d81caa9cc1a None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336/users/4c8e1dd3b1284e1fb7020582f65287ba/roles/07eba1cca2a34e7bbde6d6a82772b4ae` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:09.420036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8341c54-70e8-4fa3-8290-1d81caa9cc1a None admin] RBAC: Authorizing `identity:create_grant(project_id=d94efb6a61fb468abaff458dda955336, user_id=4c8e1dd3b1284e1fb7020582f65287ba, role_id=07eba1cca2a34e7bbde6d6a82772b4ae)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:09.423651 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8341c54-70e8-4fa3-8290-1d81caa9cc1a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:09.448622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 74/154] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 13:59:09 2022] PUT /identity/v3/projects/d94efb6a61fb468abaff458dda955336/users/4c8e1dd3b1284e1fb7020582f65287ba/roles/07eba1cca2a34e7bbde6d6a82772b4ae => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:09.470213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9655bd5-28ab-439b-b683-5e533942f427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:09.470213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655bd5-28ab-439b-b683-5e533942f427 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:09.470213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655bd5-28ab-439b-b683-5e533942f427 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:09.470213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655bd5-28ab-439b-b683-5e533942f427 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:09.475562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9655bd5-28ab-439b-b683-5e533942f427 None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:09.482226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9655bd5-28ab-439b-b683-5e533942f427 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:09.482226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 81/155] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:09 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:09.486505 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8341c54-70e8-4fa3-8290-1d81caa9cc1a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:09.620157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:09.690186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8341c54-70e8-4fa3-8290-1d81caa9cc1a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:09.758911 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d712f-9ffa-46c1-8c3b-e835698f1f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:09.760062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d712f-9ffa-46c1-8c3b-e835698f1f7c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:09.760552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d712f-9ffa-46c1-8c3b-e835698f1f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:09.761051 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d712f-9ffa-46c1-8c3b-e835698f1f7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:09.762145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d712f-9ffa-46c1-8c3b-e835698f1f7c None admin] RBAC: Adding query filter params (role.id=8b1dade745704cf3a2a92b5ac07853b4, scope.project.id=d94efb6a61fb468abaff458dda955336, user.id=9aeaa5e28ef143efbeeae1af9fd653f7) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:09.762683 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d712f-9ffa-46c1-8c3b-e835698f1f7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:09.764350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d712f-9ffa-46c1-8c3b-e835698f1f7c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:09.771730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 75/156] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:09 2022] GET /identity/v3/role_assignments?user.id=9aeaa5e28ef143efbeeae1af9fd653f7&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:10.658533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654b5a-9329-44b8-b2fd-3e976b8785e5 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:10.659042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654b5a-9329-44b8-b2fd-3e976b8785e5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:10.659138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654b5a-9329-44b8-b2fd-3e976b8785e5 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:10.660469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 82/157] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:10.666650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505167-d1a8-470a-a7d0-52192acc07db None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:10.669154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505167-d1a8-470a-a7d0-52192acc07db None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:10.669154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9505167-d1a8-470a-a7d0-52192acc07db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:10.687717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a9505167-d1a8-470a-a7d0-52192acc07db None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:10.689235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a9505167-d1a8-470a-a7d0-52192acc07db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:10.762016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 76/158] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:10.786481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48654b5a-9329-44b8-b2fd-3e976b8785e5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:10.915420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48654b5a-9329-44b8-b2fd-3e976b8785e5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:10.943871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8c3b-e02b-4534-9d3c-0fd6ce2a7a78 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:10.944973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8c3b-e02b-4534-9d3c-0fd6ce2a7a78 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:10.945504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8c3b-e02b-4534-9d3c-0fd6ce2a7a78 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:10.948143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 77/159] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:10.960697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be062789-1c69-447c-935f-c393db4cbbfd None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:10.961652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be062789-1c69-447c-935f-c393db4cbbfd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:10.962143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be062789-1c69-447c-935f-c393db4cbbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:10.971254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49516c23-4851-4ef7-9dce-ba53da187204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:10.972352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49516c23-4851-4ef7-9dce-ba53da187204 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:10.972641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49516c23-4851-4ef7-9dce-ba53da187204 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:10.972922 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49516c23-4851-4ef7-9dce-ba53da187204 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:10.993194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:10.995512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-be062789-1c69-447c-935f-c393db4cbbfd None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:10.996934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-be062789-1c69-447c-935f-c393db4cbbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:10.999076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49516c23-4851-4ef7-9dce-ba53da187204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-49516c23-4851-4ef7-9dce-ba53da187204 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:11.010604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:11.011547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:11.012314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 83/160] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:11.046189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49516c23-4851-4ef7-9dce-ba53da187204 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:11.088895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:11.111675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 78/161] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:11.168953 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be062789-1c69-447c-935f-c393db4cbbfd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:11.223607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49516c23-4851-4ef7-9dce-ba53da187204 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:11.282840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed883e22-2837-49b8-81cd-19f3d452c14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:11.283530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed883e22-2837-49b8-81cd-19f3d452c14d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:11.283813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed883e22-2837-49b8-81cd-19f3d452c14d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:11.284087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed883e22-2837-49b8-81cd-19f3d452c14d None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:11.284856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed883e22-2837-49b8-81cd-19f3d452c14d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:11.285167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed883e22-2837-49b8-81cd-19f3d452c14d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:11.286681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed883e22-2837-49b8-81cd-19f3d452c14d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:11.302066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 84/162] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:11.318824 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed883e22-2837-49b8-81cd-19f3d452c14d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:11.329847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be062789-1c69-447c-935f-c393db4cbbfd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:11.392256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48da19-7663-4e74-bf18-56e583f3178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:11.393069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48da19-7663-4e74-bf18-56e583f3178c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:11.393355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48da19-7663-4e74-bf18-56e583f3178c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:11.393633 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48da19-7663-4e74-bf18-56e583f3178c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:11.415495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48da19-7663-4e74-bf18-56e583f3178c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-cc48da19-7663-4e74-bf18-56e583f3178c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:11.432934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:11.433856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:11.434722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 79/163] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:11.438065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd1dbf-b338-4cff-8dea-0ba846bf4af6 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:11.438065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd1dbf-b338-4cff-8dea-0ba846bf4af6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:11.438065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd1dbf-b338-4cff-8dea-0ba846bf4af6 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:11.438065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 80/164] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:11.442268 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd1dbf-b338-4cff-8dea-0ba846bf4af6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:11.442797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:11.511934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed883e22-2837-49b8-81cd-19f3d452c14d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:11.534543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:11.591463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaa2a6-a567-4d81-93f1-7358ffd3e0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:11.592366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaa2a6-a567-4d81-93f1-7358ffd3e0de None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:11.592656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaa2a6-a567-4d81-93f1-7358ffd3e0de None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:11.592938 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaa2a6-a567-4d81-93f1-7358ffd3e0de None admin] PATH_INFO: `/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:11.595041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaa2a6-a567-4d81-93f1-7358ffd3e0de None admin] RBAC: Authorizing `identity:get_user(user_id=9aeaa5e28ef143efbeeae1af9fd653f7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:11.596518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaa2a6-a567-4d81-93f1-7358ffd3e0de None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:11.598218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 85/165] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:11 2022] GET /identity/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:11.599416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2815b-edc6-4160-9662-756eb08fffae None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:11.599705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2815b-edc6-4160-9662-756eb08fffae None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:11.599987 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2815b-edc6-4160-9662-756eb08fffae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:11.639130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2fc2815b-edc6-4160-9662-756eb08fffae None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:11.639322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd1dbf-b338-4cff-8dea-0ba846bf4af6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:11.640364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2fc2815b-edc6-4160-9662-756eb08fffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:11.702967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb13a6-fbe7-4d58-bae3-71e07ff25569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:11.704330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb13a6-fbe7-4d58-bae3-71e07ff25569 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:11.704814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb13a6-fbe7-4d58-bae3-71e07ff25569 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:11.705300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb13a6-fbe7-4d58-bae3-71e07ff25569 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:11.706297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb13a6-fbe7-4d58-bae3-71e07ff25569 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:11.706806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb13a6-fbe7-4d58-bae3-71e07ff25569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:11.708472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb13a6-fbe7-4d58-bae3-71e07ff25569 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:11.725560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 81/166] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:11.726929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb13a6-fbe7-4d58-bae3-71e07ff25569 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:11.794095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 86/167] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:11.795000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2815b-edc6-4160-9662-756eb08fffae None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:11.902532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:11.939370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb13a6-fbe7-4d58-bae3-71e07ff25569 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:11.955083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:11.993621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50065823-5a47-4eec-93e9-152d3993fd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:11.994588 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50065823-5a47-4eec-93e9-152d3993fd62 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:11.995032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50065823-5a47-4eec-93e9-152d3993fd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:11.995317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50065823-5a47-4eec-93e9-152d3993fd62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.012488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2815b-edc6-4160-9662-756eb08fffae None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:12.070044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50065823-5a47-4eec-93e9-152d3993fd62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:12.071623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50065823-5a47-4eec-93e9-152d3993fd62 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:12.120201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6f242-2c46-46fb-851f-0b4d0b309098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:12.121104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f242-2c46-46fb-851f-0b4d0b309098 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:12.121392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f242-2c46-46fb-851f-0b4d0b309098 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:12.121669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f242-2c46-46fb-851f-0b4d0b309098 None admin] PATH_INFO: `/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.122909 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6f242-2c46-46fb-851f-0b4d0b309098 None admin] RBAC: Authorizing `identity:get_user(user_id=477dddd95e9e4c9dab1e4c703d6c3e08)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:12.124371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6f242-2c46-46fb-851f-0b4d0b309098 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:12.126012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 87/168] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:11 2022] GET /identity/v3/users/477dddd95e9e4c9dab1e4c703d6c3e08 => generated 247 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:12.126834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6f242-2c46-46fb-851f-0b4d0b309098 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:12.179538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 82/169] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:12.181074 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf7660-010c-4b48-bea2-c4a571ba9882 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:12.181944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf7660-010c-4b48-bea2-c4a571ba9882 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:12.182425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf7660-010c-4b48-bea2-c4a571ba9882 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.183977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 83/170] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:12.184833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf7660-010c-4b48-bea2-c4a571ba9882 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:12.214251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:12.331366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf7660-010c-4b48-bea2-c4a571ba9882 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:12.347288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6f242-2c46-46fb-851f-0b4d0b309098 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:12.366779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293bafd-61bd-4766-b117-261d02e6649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:12.367445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293bafd-61bd-4766-b117-261d02e6649f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:12.367727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293bafd-61bd-4766-b117-261d02e6649f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:12.368002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293bafd-61bd-4766-b117-261d02e6649f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.398005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:12.414860 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8513b-0efa-4dd7-ab48-62e3b95ba6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:12.415723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8513b-0efa-4dd7-ab48-62e3b95ba6bf None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:12.416072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8513b-0efa-4dd7-ab48-62e3b95ba6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:12.416455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd8513b-0efa-4dd7-ab48-62e3b95ba6bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.439395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd8513b-0efa-4dd7-ab48-62e3b95ba6bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:12.441853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293bafd-61bd-4766-b117-261d02e6649f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:12.443374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293bafd-61bd-4766-b117-261d02e6649f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-1cd8513b-0efa-4dd7-ab48-62e3b95ba6bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:12.455394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:12.456319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:12.457127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 88/171] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:12.457843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8513b-0efa-4dd7-ab48-62e3b95ba6bf None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:12.463251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:12.623501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 84/172] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:12.624757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de74a2-d580-4ffc-b8e4-6acb1a9ab7b0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:12.625046 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de74a2-d580-4ffc-b8e4-6acb1a9ab7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:12.625321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de74a2-d580-4ffc-b8e4-6acb1a9ab7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.648158 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd8513b-0efa-4dd7-ab48-62e3b95ba6bf None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:12.651960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-44de74a2-d580-4ffc-b8e4-6acb1a9ab7b0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:12.653222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-44de74a2-d580-4ffc-b8e4-6acb1a9ab7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:12.716539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd7b3f-4980-4ebc-bbf1-7f910de77f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:12.717851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd7b3f-4980-4ebc-bbf1-7f910de77f21 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:12.718450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd7b3f-4980-4ebc-bbf1-7f910de77f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:12.718937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd7b3f-4980-4ebc-bbf1-7f910de77f21 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.723010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd7b3f-4980-4ebc-bbf1-7f910de77f21 None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:12.724712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd7b3f-4980-4ebc-bbf1-7f910de77f21 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:12.727163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 89/173] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:12 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:12.728200 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd7b3f-4980-4ebc-bbf1-7f910de77f21 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:12.757524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 85/174] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:12.759113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de74a2-d580-4ffc-b8e4-6acb1a9ab7b0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:12.819672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:12.858548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:12.880254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd7b3f-4980-4ebc-bbf1-7f910de77f21 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:12.917841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a6c32-d798-4a89-beef-878f4bfbdafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:12.919119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a6c32-d798-4a89-beef-878f4bfbdafb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:12.919724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a6c32-d798-4a89-beef-878f4bfbdafb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:12.920216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a6c32-d798-4a89-beef-878f4bfbdafb None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:12.921197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a6c32-d798-4a89-beef-878f4bfbdafb None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:12.921718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a6c32-d798-4a89-beef-878f4bfbdafb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:12.923376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a6c32-d798-4a89-beef-878f4bfbdafb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:12.934098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 90/175] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:12.935272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a6c32-d798-4a89-beef-878f4bfbdafb None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:12.963169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de74a2-d580-4ffc-b8e4-6acb1a9ab7b0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.010516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db7fe0-398d-4430-aa3e-2086afd5c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.011987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db7fe0-398d-4430-aa3e-2086afd5c18b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.012825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db7fe0-398d-4430-aa3e-2086afd5c18b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.013559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db7fe0-398d-4430-aa3e-2086afd5c18b None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.015300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db7fe0-398d-4430-aa3e-2086afd5c18b None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.017869 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db7fe0-398d-4430-aa3e-2086afd5c18b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:13.020819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 86/176] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:12 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:13.021818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db7fe0-398d-4430-aa3e-2086afd5c18b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.061073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a6c32-d798-4a89-beef-878f4bfbdafb None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.078583 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:13.097010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf28c50-fb53-4125-b7cb-bd6618aef884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.097673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf28c50-fb53-4125-b7cb-bd6618aef884 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.097963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf28c50-fb53-4125-b7cb-bd6618aef884 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.098270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf28c50-fb53-4125-b7cb-bd6618aef884 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.099119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf28c50-fb53-4125-b7cb-bd6618aef884 None admin] RBAC: Adding query filter params (role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7, scope.project.id=d94efb6a61fb468abaff458dda955336, user.id=9aeaa5e28ef143efbeeae1af9fd653f7) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:13.099436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf28c50-fb53-4125-b7cb-bd6618aef884 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.100892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf28c50-fb53-4125-b7cb-bd6618aef884 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:13.106944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 91/177] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:12 2022] GET /identity/v3/role_assignments?user.id=9aeaa5e28ef143efbeeae1af9fd653f7&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:13.108194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b9f89-d569-4134-a286-3928f9ae5805 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.108484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b9f89-d569-4134-a286-3928f9ae5805 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.108767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b9f89-d569-4134-a286-3928f9ae5805 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.110183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 92/178] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:13.110762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b9f89-d569-4134-a286-3928f9ae5805 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.143518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db7fe0-398d-4430-aa3e-2086afd5c18b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.157063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:13.189676 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f617843-d489-4147-9199-c223123795d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.190983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f617843-d489-4147-9199-c223123795d2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.191521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f617843-d489-4147-9199-c223123795d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.192006 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f617843-d489-4147-9199-c223123795d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.212245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f617843-d489-4147-9199-c223123795d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7f617843-d489-4147-9199-c223123795d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:13.221190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:13.222188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:13.224115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 87/179] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:13.227150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e1fe-60ef-4e32-af94-75713f7bd794 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.227707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e1fe-60ef-4e32-af94-75713f7bd794 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.228212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e1fe-60ef-4e32-af94-75713f7bd794 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.230805 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 88/180] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:13.231618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5e1fe-60ef-4e32-af94-75713f7bd794 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.242305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b9f89-d569-4134-a286-3928f9ae5805 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.289417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d0fa3-395f-479b-b704-007c51f32f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.290306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d0fa3-395f-479b-b704-007c51f32f0a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.291118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d0fa3-395f-479b-b704-007c51f32f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.291430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d0fa3-395f-479b-b704-007c51f32f0a None admin] PATH_INFO: `/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.293324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d0fa3-395f-479b-b704-007c51f32f0a None admin] RBAC: Authorizing `identity:get_user(user_id=9aeaa5e28ef143efbeeae1af9fd653f7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.294841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d0fa3-395f-479b-b704-007c51f32f0a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:13.301282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 93/181] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/users/9aeaa5e28ef143efbeeae1af9fd653f7 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:13.301282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1ffca-d2b5-4b9e-a1f6-97ffed28cdd9 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.301282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1ffca-d2b5-4b9e-a1f6-97ffed28cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.301282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1ffca-d2b5-4b9e-a1f6-97ffed28cdd9 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.301282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 94/182] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:13.302130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb4c8-6604-46f3-8ec7-9acc620edd26 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.302474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb4c8-6604-46f3-8ec7-9acc620edd26 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.302756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb4c8-6604-46f3-8ec7-9acc620edd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.321737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f68cb4c8-6604-46f3-8ec7-9acc620edd26 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:13.323108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f68cb4c8-6604-46f3-8ec7-9acc620edd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:13.373991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5e1fe-60ef-4e32-af94-75713f7bd794 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.374534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:13.399218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 95/183] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:13.403026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cb4c8-6604-46f3-8ec7-9acc620edd26 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.408227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506bdf3-39f0-4de2-930a-507bca289fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.408915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506bdf3-39f0-4de2-930a-507bca289fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.409202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506bdf3-39f0-4de2-930a-507bca289fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.409482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506bdf3-39f0-4de2-930a-507bca289fa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.410384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506bdf3-39f0-4de2-930a-507bca289fa9 None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=d94efb6a61fb468abaff458dda955336, user.id=477dddd95e9e4c9dab1e4c703d6c3e08) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:13.410721 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506bdf3-39f0-4de2-930a-507bca289fa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.412202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506bdf3-39f0-4de2-930a-507bca289fa9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:13.418899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 89/184] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/role_assignments?user.id=477dddd95e9e4c9dab1e4c703d6c3e08&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=57f1335a97b5490cb0853894c2faf62c => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:13.424389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a422bfd-683b-4b93-8e5d-8037d7702875 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.424677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a422bfd-683b-4b93-8e5d-8037d7702875 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.425015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a422bfd-683b-4b93-8e5d-8037d7702875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.444331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0a422bfd-683b-4b93-8e5d-8037d7702875 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:13.445581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0a422bfd-683b-4b93-8e5d-8037d7702875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:13.477809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:13.530785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 90/185] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:13.531720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cb4c8-6604-46f3-8ec7-9acc620edd26 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.532168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a422bfd-683b-4b93-8e5d-8037d7702875 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.577544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4ef0b-e2e6-4a0f-8075-d531b1fea33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.578282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4ef0b-e2e6-4a0f-8075-d531b1fea33a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.578576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4ef0b-e2e6-4a0f-8075-d531b1fea33a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.578856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4ef0b-e2e6-4a0f-8075-d531b1fea33a None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.579624 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4ef0b-e2e6-4a0f-8075-d531b1fea33a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:13.579994 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4ef0b-e2e6-4a0f-8075-d531b1fea33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.581439 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac4ef0b-e2e6-4a0f-8075-d531b1fea33a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:13.595852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 96/186] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:13.597264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689390cd-18a3-4612-8450-fbadbee9eb05 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.597567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689390cd-18a3-4612-8450-fbadbee9eb05 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.597852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689390cd-18a3-4612-8450-fbadbee9eb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.621572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-689390cd-18a3-4612-8450-fbadbee9eb05 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:13.623225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-689390cd-18a3-4612-8450-fbadbee9eb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:13.664724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a422bfd-683b-4b93-8e5d-8037d7702875 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.669894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:13.705108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 97/187] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:13.706270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689390cd-18a3-4612-8450-fbadbee9eb05 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.719478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e5409-b232-424f-8abb-87af27e82129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.720162 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e5409-b232-424f-8abb-87af27e82129 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.720446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e5409-b232-424f-8abb-87af27e82129 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.720724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e5409-b232-424f-8abb-87af27e82129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.753796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:13.792187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e5409-b232-424f-8abb-87af27e82129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.793694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e5409-b232-424f-8abb-87af27e82129 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:13.813903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689390cd-18a3-4612-8450-fbadbee9eb05 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.848147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea571-fdad-41f9-a197-2b41fda75dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:13.849000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea571-fdad-41f9-a197-2b41fda75dfb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:13.849287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea571-fdad-41f9-a197-2b41fda75dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:13.849816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aea571-fdad-41f9-a197-2b41fda75dfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:13.850835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aea571-fdad-41f9-a197-2b41fda75dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:13.852275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aea571-fdad-41f9-a197-2b41fda75dfb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:13.854578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 98/188] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:13.855349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea571-fdad-41f9-a197-2b41fda75dfb None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.894662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 91/189] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:13.895770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e5409-b232-424f-8abb-87af27e82129 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:13.903176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:13.957674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:13.964609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aea571-fdad-41f9-a197-2b41fda75dfb None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:13.996271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e5409-b232-424f-8abb-87af27e82129 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.012365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ffd34-a693-4318-adc1-ce25d9957553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.013217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ffd34-a693-4318-adc1-ce25d9957553 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.013507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ffd34-a693-4318-adc1-ce25d9957553 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.013790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ffd34-a693-4318-adc1-ce25d9957553 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.028195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ffd34-a693-4318-adc1-ce25d9957553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:14.037391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a59b0-8441-4c21-aa21-f81721833f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.038312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a59b0-8441-4c21-aa21-f81721833f5c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8e8ffd34-a693-4318-adc1-ce25d9957553 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:14.038444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:14.039345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:14.040157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:14.040838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a59b0-8441-4c21-aa21-f81721833f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.040838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a59b0-8441-4c21-aa21-f81721833f5c None admin] PATH_INFO: `/v3/users/178874e85c2642b596b90cfa5a89d04d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.040967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 99/190] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:14.040967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ffd34-a693-4318-adc1-ce25d9957553 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.056386 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a59b0-8441-4c21-aa21-f81721833f5c None admin] RBAC: Authorizing `identity:get_user(user_id=178874e85c2642b596b90cfa5a89d04d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.057878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a59b0-8441-4c21-aa21-f81721833f5c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.059681 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 92/191] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:13 2022] GET /identity/v3/users/178874e85c2642b596b90cfa5a89d04d => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:14.060435 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a59b0-8441-4c21-aa21-f81721833f5c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.140928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:14.145261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ffd34-a693-4318-adc1-ce25d9957553 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.163119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a59b0-8441-4c21-aa21-f81721833f5c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.178734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445238e-fbdb-4276-9fb7-42cd9e403d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.179532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445238e-fbdb-4276-9fb7-42cd9e403d9e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.179826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445238e-fbdb-4276-9fb7-42cd9e403d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.180097 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445238e-fbdb-4276-9fb7-42cd9e403d9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.187872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:14.190660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445238e-fbdb-4276-9fb7-42cd9e403d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a445238e-fbdb-4276-9fb7-42cd9e403d9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:14.199143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:14.200087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:14.200870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 100/192] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:14.201558 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445238e-fbdb-4276-9fb7-42cd9e403d9e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.207619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16399af-9c6f-4c2b-bdb5-3d27f05336ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.208226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16399af-9c6f-4c2b-bdb5-3d27f05336ae None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.208454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16399af-9c6f-4c2b-bdb5-3d27f05336ae None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.208730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16399af-9c6f-4c2b-bdb5-3d27f05336ae None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.209466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16399af-9c6f-4c2b-bdb5-3d27f05336ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.211000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16399af-9c6f-4c2b-bdb5-3d27f05336ae None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.231112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 93/193] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:59:14 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:14.231940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16399af-9c6f-4c2b-bdb5-3d27f05336ae None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.322532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445238e-fbdb-4276-9fb7-42cd9e403d9e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.347673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16399af-9c6f-4c2b-bdb5-3d27f05336ae None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.364375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba4dee-df05-429e-81a5-4999a297e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.365908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba4dee-df05-429e-81a5-4999a297e5ae None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.366466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba4dee-df05-429e-81a5-4999a297e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.367135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba4dee-df05-429e-81a5-4999a297e5ae None admin] PATH_INFO: `/v3/projects/dc81eb9056e7477db7832643c2fe91de` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.370288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba4dee-df05-429e-81a5-4999a297e5ae None admin] RBAC: Authorizing `identity:get_project(project_id=dc81eb9056e7477db7832643c2fe91de)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.372508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba4dee-df05-429e-81a5-4999a297e5ae None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.379501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 101/194] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/projects/dc81eb9056e7477db7832643c2fe91de => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:14.379501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba4dee-df05-429e-81a5-4999a297e5ae None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.399581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686039f5-d1d8-4cdf-af3c-ae09214ee3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.400501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686039f5-d1d8-4cdf-af3c-ae09214ee3da None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.400816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686039f5-d1d8-4cdf-af3c-ae09214ee3da None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.401127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686039f5-d1d8-4cdf-af3c-ae09214ee3da None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.402615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686039f5-d1d8-4cdf-af3c-ae09214ee3da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:14.403174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686039f5-d1d8-4cdf-af3c-ae09214ee3da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.404972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686039f5-d1d8-4cdf-af3c-ae09214ee3da None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.418106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 94/195] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:14.419669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686039f5-d1d8-4cdf-af3c-ae09214ee3da None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.432362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:14.484519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:14.530012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba4dee-df05-429e-81a5-4999a297e5ae None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.567732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686039f5-d1d8-4cdf-af3c-ae09214ee3da None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.572930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed2a9a-d520-4622-9723-8bf6bc42fefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.573597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2a9a-d520-4622-9723-8bf6bc42fefd None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.573883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2a9a-d520-4622-9723-8bf6bc42fefd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.574174 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed2a9a-d520-4622-9723-8bf6bc42fefd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.611399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb9746-ec53-425d-bba4-7a71020ca83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.612086 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb9746-ec53-425d-bba4-7a71020ca83f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.612371 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb9746-ec53-425d-bba4-7a71020ca83f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.612673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb9746-ec53-425d-bba4-7a71020ca83f None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.613537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb9746-ec53-425d-bba4-7a71020ca83f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:14.613925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb9746-ec53-425d-bba4-7a71020ca83f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.615368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb9746-ec53-425d-bba4-7a71020ca83f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.626453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 95/196] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:14.627350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb9746-ec53-425d-bba4-7a71020ca83f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.660736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed2a9a-d520-4622-9723-8bf6bc42fefd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.662726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed2a9a-d520-4622-9723-8bf6bc42fefd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.702175 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:14.736553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb9746-ec53-425d-bba4-7a71020ca83f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:14.738624 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:14.782090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da88575-1528-405a-9b5f-a870ca887a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:14.783110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da88575-1528-405a-9b5f-a870ca887a4c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:14.783541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da88575-1528-405a-9b5f-a870ca887a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:14.783972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da88575-1528-405a-9b5f-a870ca887a4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:14.784960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da88575-1528-405a-9b5f-a870ca887a4c None admin] RBAC: Adding query filter params (role.id=8b1dade745704cf3a2a92b5ac07853b4, scope.project.id=dc81eb9056e7477db7832643c2fe91de, user.id=9aeaa5e28ef143efbeeae1af9fd653f7) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:14.785476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da88575-1528-405a-9b5f-a870ca887a4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:14.787523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da88575-1528-405a-9b5f-a870ca887a4c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:14.795949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 96/197] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/role_assignments?user.id=9aeaa5e28ef143efbeeae1af9fd653f7&scope.project.id=dc81eb9056e7477db7832643c2fe91de&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:14.797604 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da88575-1528-405a-9b5f-a870ca887a4c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:14.843185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 102/198] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:14.848115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed2a9a-d520-4622-9723-8bf6bc42fefd None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:15.017314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da88575-1528-405a-9b5f-a870ca887a4c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:15.037538 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed2a9a-d520-4622-9723-8bf6bc42fefd None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:15.061725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec125b-51b6-4d18-83e5-ab054d6a3811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:15.063254 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec125b-51b6-4d18-83e5-ab054d6a3811 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:15.063549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec125b-51b6-4d18-83e5-ab054d6a3811 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:15.063830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec125b-51b6-4d18-83e5-ab054d6a3811 None admin] PATH_INFO: `/v3/users/178874e85c2642b596b90cfa5a89d04d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:15.065391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec125b-51b6-4d18-83e5-ab054d6a3811 None admin] RBAC: Authorizing `identity:get_user(user_id=178874e85c2642b596b90cfa5a89d04d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:15.068145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec125b-51b6-4d18-83e5-ab054d6a3811 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:15.069778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 97/199] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/users/178874e85c2642b596b90cfa5a89d04d => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:15.070959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:15.072451 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec125b-51b6-4d18-83e5-ab054d6a3811 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:15.086526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fd193-05e6-4bb1-84c5-f6e3c5ed5c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:15.088056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fd193-05e6-4bb1-84c5-f6e3c5ed5c5f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:15.088270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fd193-05e6-4bb1-84c5-f6e3c5ed5c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:15.088719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fd193-05e6-4bb1-84c5-f6e3c5ed5c5f None admin] PATH_INFO: `/v3/users/4c8e1dd3b1284e1fb7020582f65287ba` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:15.090065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fd193-05e6-4bb1-84c5-f6e3c5ed5c5f None admin] RBAC: Authorizing `identity:get_user(user_id=4c8e1dd3b1284e1fb7020582f65287ba)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:15.091587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fd193-05e6-4bb1-84c5-f6e3c5ed5c5f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:15.093670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 103/200] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:14 2022] GET /identity/v3/users/4c8e1dd3b1284e1fb7020582f65287ba => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:15.094397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fd193-05e6-4bb1-84c5-f6e3c5ed5c5f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:15.114673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:15.211346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec125b-51b6-4d18-83e5-ab054d6a3811 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:15.224295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fd193-05e6-4bb1-84c5-f6e3c5ed5c5f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:15.256088 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dd9ab-0b1a-4ea5-a35b-4255633ed902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:15.257117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dd9ab-0b1a-4ea5-a35b-4255633ed902 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:15.257530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dd9ab-0b1a-4ea5-a35b-4255633ed902 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:15.257962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dd9ab-0b1a-4ea5-a35b-4255633ed902 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:15.261223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dd9ab-0b1a-4ea5-a35b-4255633ed902 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:15.262879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dd9ab-0b1a-4ea5-a35b-4255633ed902 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:15.264740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 98/201] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:15 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:15.265604 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dd9ab-0b1a-4ea5-a35b-4255633ed902 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:15.280001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595c690-c896-4650-a278-e1d961ba8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:15.280899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c690-c896-4650-a278-e1d961ba8566 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:15.281358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c690-c896-4650-a278-e1d961ba8566 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:15.282265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c690-c896-4650-a278-e1d961ba8566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:15.366747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:15.377391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595c690-c896-4650-a278-e1d961ba8566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:15.379101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595c690-c896-4650-a278-e1d961ba8566 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:15.393080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dd9ab-0b1a-4ea5-a35b-4255633ed902 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:15.395145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:15.434548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f70cae-1e35-4983-a527-d068d12dd316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:15.435368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f70cae-1e35-4983-a527-d068d12dd316 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:15.435752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f70cae-1e35-4983-a527-d068d12dd316 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:15.436134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f70cae-1e35-4983-a527-d068d12dd316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:15.505340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 104/202] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:15.506453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595c690-c896-4650-a278-e1d961ba8566 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:15.512943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f70cae-1e35-4983-a527-d068d12dd316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:15.514358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f70cae-1e35-4983-a527-d068d12dd316 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:15.613369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:15.621615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595c690-c896-4650-a278-e1d961ba8566 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:15.659508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df565bf-703c-4788-9c5e-2a948f0a39da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:15.660561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df565bf-703c-4788-9c5e-2a948f0a39da None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:15.661051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df565bf-703c-4788-9c5e-2a948f0a39da None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:15.661546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df565bf-703c-4788-9c5e-2a948f0a39da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:15.662083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 99/203] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:15.662852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f70cae-1e35-4983-a527-d068d12dd316 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:15.663428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df565bf-703c-4788-9c5e-2a948f0a39da None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac, user.id=178874e85c2642b596b90cfa5a89d04d) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:15.663946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df565bf-703c-4788-9c5e-2a948f0a39da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:15.665673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df565bf-703c-4788-9c5e-2a948f0a39da None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:15.672373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 105/204] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:15 2022] GET /identity/v3/role_assignments?user.id=178874e85c2642b596b90cfa5a89d04d&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=57f1335a97b5490cb0853894c2faf62c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:15.673567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df565bf-703c-4788-9c5e-2a948f0a39da None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:15.674719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:15.859795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df565bf-703c-4788-9c5e-2a948f0a39da None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:15.861970 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f70cae-1e35-4983-a527-d068d12dd316 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:15.926862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681a99b-2647-4136-b853-8f76dbce58cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:15.927819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc03c36-c0f2-4362-9936-befdf4abca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:15.929507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc03c36-c0f2-4362-9936-befdf4abca42 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:15.930076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681a99b-2647-4136-b853-8f76dbce58cc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:15.930578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc03c36-c0f2-4362-9936-befdf4abca42 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:15.931054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681a99b-2647-4136-b853-8f76dbce58cc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:15.932136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc03c36-c0f2-4362-9936-befdf4abca42 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:15.932627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681a99b-2647-4136-b853-8f76dbce58cc None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:15.934651 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc03c36-c0f2-4362-9936-befdf4abca42 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:15.935514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681a99b-2647-4136-b853-8f76dbce58cc None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:15.937182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681a99b-2647-4136-b853-8f76dbce58cc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:15.938846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc03c36-c0f2-4362-9936-befdf4abca42 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:15.942786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 106/205] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:15 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:15.943213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 100/206] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:15 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:15.953090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc03c36-c0f2-4362-9936-befdf4abca42 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:15.954394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681a99b-2647-4136-b853-8f76dbce58cc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:16.034338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:16.046596 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:16.084646 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc03c36-c0f2-4362-9936-befdf4abca42 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:16.124877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dfd2a-a1d4-446b-966e-94f15a3e8e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:16.125951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dfd2a-a1d4-446b-966e-94f15a3e8e24 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:16.126273 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dfd2a-a1d4-446b-966e-94f15a3e8e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:16.126559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dfd2a-a1d4-446b-966e-94f15a3e8e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:16.127437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dfd2a-a1d4-446b-966e-94f15a3e8e24 None admin] RBAC: Adding query filter params (role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac, user.id=178874e85c2642b596b90cfa5a89d04d) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:16.127760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dfd2a-a1d4-446b-966e-94f15a3e8e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:16.129246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dfd2a-a1d4-446b-966e-94f15a3e8e24 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:16.136516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 101/207] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:15 2022] GET /identity/v3/role_assignments?user.id=178874e85c2642b596b90cfa5a89d04d&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:16.226524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681a99b-2647-4136-b853-8f76dbce58cc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:16.288228 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecac73-7028-47dc-bf06-9b93972e4b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:16.288916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecac73-7028-47dc-bf06-9b93972e4b86 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:16.289390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecac73-7028-47dc-bf06-9b93972e4b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:16.289687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecac73-7028-47dc-bf06-9b93972e4b86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:16.290666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecac73-7028-47dc-bf06-9b93972e4b86 None admin] RBAC: Adding query filter params (role.id=07eba1cca2a34e7bbde6d6a82772b4ae, scope.project.id=d94efb6a61fb468abaff458dda955336, user.id=4c8e1dd3b1284e1fb7020582f65287ba) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:16.291130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecac73-7028-47dc-bf06-9b93972e4b86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:16.292647 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecac73-7028-47dc-bf06-9b93972e4b86 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:16.303285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 107/208] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:15 2022] GET /identity/v3/role_assignments?user.id=4c8e1dd3b1284e1fb7020582f65287ba&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=07eba1cca2a34e7bbde6d6a82772b4ae => generated 608 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:16.637300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec8268-0726-4ac9-9271-ddac9fd5e870 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:16.637667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec8268-0726-4ac9-9271-ddac9fd5e870 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:16.637874 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec8268-0726-4ac9-9271-ddac9fd5e870 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:16.639475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 102/209] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:16.645360 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3da7ea-0529-4155-8efa-13636538dd25 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:16.645914 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3da7ea-0529-4155-8efa-13636538dd25 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:16.646465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3da7ea-0529-4155-8efa-13636538dd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:16.666483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-fc3da7ea-0529-4155-8efa-13636538dd25 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:16.668088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fc3da7ea-0529-4155-8efa-13636538dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:16.697286 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeb1ab-fff6-40c8-8c4d-9642f7df99e5 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:16.697722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeb1ab-fff6-40c8-8c4d-9642f7df99e5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:16.697848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceeb1ab-fff6-40c8-8c4d-9642f7df99e5 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:16.699412 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 103/210] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:16.704542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d86583-4b47-4aa4-af46-9ade2fc5fedd None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:16.704836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d86583-4b47-4aa4-af46-9ade2fc5fedd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:16.705120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d86583-4b47-4aa4-af46-9ade2fc5fedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:16.724691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b9d86583-4b47-4aa4-af46-9ade2fc5fedd None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:16.726256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b9d86583-4b47-4aa4-af46-9ade2fc5fedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:16.748736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 108/211] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:16.772455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3da7ea-0529-4155-8efa-13636538dd25 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:16.798230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:16.826178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 104/212] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:16.850379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d86583-4b47-4aa4-af46-9ade2fc5fedd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:16.894393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3da7ea-0529-4155-8efa-13636538dd25 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:16.917199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:16.935286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8e025-dcc5-44cf-a10b-ad504444e79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:16.936426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8e025-dcc5-44cf-a10b-ad504444e79c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:16.937070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8e025-dcc5-44cf-a10b-ad504444e79c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:16.937635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8e025-dcc5-44cf-a10b-ad504444e79c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:16.949629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8e025-dcc5-44cf-a10b-ad504444e79c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:16.956813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d86583-4b47-4aa4-af46-9ade2fc5fedd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-f2d8e025-dcc5-44cf-a10b-ad504444e79c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:16.958882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:16.959744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:16.960527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:16.968065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 109/213] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:16.969580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8e025-dcc5-44cf-a10b-ad504444e79c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:17.000431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a255e-2fc7-479c-b49f-9253517e2c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:17.001848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a255e-2fc7-479c-b49f-9253517e2c08 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:17.002630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a255e-2fc7-479c-b49f-9253517e2c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:17.003117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a255e-2fc7-479c-b49f-9253517e2c08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:17.005079 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a255e-2fc7-479c-b49f-9253517e2c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:17.007755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a255e-2fc7-479c-b49f-9253517e2c08 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:17.015255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 105/214] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:17.018902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a255e-2fc7-479c-b49f-9253517e2c08 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:17.075090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:17.102516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8e025-dcc5-44cf-a10b-ad504444e79c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:17.146715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a255e-2fc7-479c-b49f-9253517e2c08 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:17.151493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0004d-6f4c-48e1-9a4e-79de6c383ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:17.152441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0004d-6f4c-48e1-9a4e-79de6c383ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:17.152927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0004d-6f4c-48e1-9a4e-79de6c383ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:17.153432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0004d-6f4c-48e1-9a4e-79de6c383ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:17.154937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0004d-6f4c-48e1-9a4e-79de6c383ec0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:17.155472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0004d-6f4c-48e1-9a4e-79de6c383ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:17.157533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0004d-6f4c-48e1-9a4e-79de6c383ec0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:17.170624 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 110/215] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:17.175698 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0004d-6f4c-48e1-9a4e-79de6c383ec0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:17.188689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:17.196515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadee84-a168-4609-ab2c-89a2add4a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:17.197522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadee84-a168-4609-ab2c-89a2add4a629 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:17.198207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadee84-a168-4609-ab2c-89a2add4a629 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:17.201695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dadee84-a168-4609-ab2c-89a2add4a629 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:17.202687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadee84-a168-4609-ab2c-89a2add4a629 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:17.204396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dadee84-a168-4609-ab2c-89a2add4a629 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:17.238700 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 106/216] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:59:17 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:17.310969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0004d-6f4c-48e1-9a4e-79de6c383ec0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:17.354553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcc573-c208-4ca6-b93a-c3f23b8bcd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:17.355820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcc573-c208-4ca6-b93a-c3f23b8bcd3a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:17.356330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcc573-c208-4ca6-b93a-c3f23b8bcd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:17.356912 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcc573-c208-4ca6-b93a-c3f23b8bcd3a None admin] PATH_INFO: `/v3/users/416d33fdb9ed429b909dd3940494f8c2` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:17.372705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:17.375779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcc573-c208-4ca6-b93a-c3f23b8bcd3a None admin] RBAC: Authorizing `identity:get_user(user_id=416d33fdb9ed429b909dd3940494f8c2)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:17.377602 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcc573-c208-4ca6-b93a-c3f23b8bcd3a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:17.379740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 111/217] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:17 2022] GET /identity/v3/users/416d33fdb9ed429b909dd3940494f8c2 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:17.390292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadee84-a168-4609-ab2c-89a2add4a629 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:17.503210 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dadee84-a168-4609-ab2c-89a2add4a629 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:17.539667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576826c4-07fc-4382-9cc4-b36dbad781bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:17.540341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576826c4-07fc-4382-9cc4-b36dbad781bb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:17.541227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576826c4-07fc-4382-9cc4-b36dbad781bb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:17.541512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576826c4-07fc-4382-9cc4-b36dbad781bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:17.611517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:17.627027 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576826c4-07fc-4382-9cc4-b36dbad781bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:17.628544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576826c4-07fc-4382-9cc4-b36dbad781bb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:17.743888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 107/218] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:17.749518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcc573-c208-4ca6-b93a-c3f23b8bcd3a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:17.873323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcc573-c208-4ca6-b93a-c3f23b8bcd3a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:17.925707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b7410-575d-4d27-aa12-ade8a7b4b562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:17.926989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b7410-575d-4d27-aa12-ade8a7b4b562 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:17.927485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b7410-575d-4d27-aa12-ade8a7b4b562 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:17.927969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b7410-575d-4d27-aa12-ade8a7b4b562 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:17.929415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b7410-575d-4d27-aa12-ade8a7b4b562 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:17.931187 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b7410-575d-4d27-aa12-ade8a7b4b562 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:17.933157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 112/219] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:17 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:17.939104 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576826c4-07fc-4382-9cc4-b36dbad781bb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:18.071383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686343b-99ed-43ee-b15d-954eb7132ca4 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:18.072659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686343b-99ed-43ee-b15d-954eb7132ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:18.073172 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686343b-99ed-43ee-b15d-954eb7132ca4 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:18.074806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 113/220] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:18.080000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2b5e6-d3fe-453b-a878-287ac9be343d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:18.080542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2b5e6-d3fe-453b-a878-287ac9be343d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:18.081056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2b5e6-d3fe-453b-a878-287ac9be343d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:18.102372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:18.107874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a2e2b5e6-d3fe-453b-a878-287ac9be343d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:18.109090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a2e2b5e6-d3fe-453b-a878-287ac9be343d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:18.127470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576826c4-07fc-4382-9cc4-b36dbad781bb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:18.181549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785b0e7-e01b-463e-8581-6c4ded3cfadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:18.182728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b0e7-e01b-463e-8581-6c4ded3cfadf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:18.183172 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b0e7-e01b-463e-8581-6c4ded3cfadf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:18.183688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785b0e7-e01b-463e-8581-6c4ded3cfadf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:18.184680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785b0e7-e01b-463e-8581-6c4ded3cfadf None admin] RBAC: Adding query filter params (role.id=8b1dade745704cf3a2a92b5ac07853b4, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac, user.id=416d33fdb9ed429b909dd3940494f8c2) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:18.185169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785b0e7-e01b-463e-8581-6c4ded3cfadf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:18.186836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785b0e7-e01b-463e-8581-6c4ded3cfadf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:18.193223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 108/221] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:17 2022] GET /identity/v3/role_assignments?user.id=416d33fdb9ed429b909dd3940494f8c2&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:18.209001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 114/222] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:18.210333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:18.232188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785b0e7-e01b-463e-8581-6c4ded3cfadf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:18.390888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785b0e7-e01b-463e-8581-6c4ded3cfadf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:18.433594 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32cd2a-b57b-4e95-a85f-49497a4a4438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:18.434412 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32cd2a-b57b-4e95-a85f-49497a4a4438 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:18.434756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32cd2a-b57b-4e95-a85f-49497a4a4438 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:18.435037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32cd2a-b57b-4e95-a85f-49497a4a4438 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:18.452116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32cd2a-b57b-4e95-a85f-49497a4a4438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-5e32cd2a-b57b-4e95-a85f-49497a4a4438 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:18.460069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:18.460958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:18.461737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 109/223] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:59:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:18.467503 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2b5e6-d3fe-453b-a878-287ac9be343d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:18.579984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2b5e6-d3fe-453b-a878-287ac9be343d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:18.622383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a3ff2-43cd-4a2b-9ef8-3c8317717ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:18.623136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a3ff2-43cd-4a2b-9ef8-3c8317717ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:18.623427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a3ff2-43cd-4a2b-9ef8-3c8317717ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:18.623708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a3ff2-43cd-4a2b-9ef8-3c8317717ca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:18.624545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a3ff2-43cd-4a2b-9ef8-3c8317717ca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:18.624862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a3ff2-43cd-4a2b-9ef8-3c8317717ca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:18.626283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a3ff2-43cd-4a2b-9ef8-3c8317717ca0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:18.635860 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 115/224] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:18.641054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32cd2a-b57b-4e95-a85f-49497a4a4438 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:18.661094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:18.691186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c9407-ff75-4abd-962e-cbc282f0a84a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:18.691486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c9407-ff75-4abd-962e-cbc282f0a84a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:18.691759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c9407-ff75-4abd-962e-cbc282f0a84a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:18.693150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 116/225] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:18.698608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273ae1f-dbf9-49fc-b016-8ab4fef33d6b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:18.698955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273ae1f-dbf9-49fc-b016-8ab4fef33d6b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:18.699264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273ae1f-dbf9-49fc-b016-8ab4fef33d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:18.726499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4273ae1f-dbf9-49fc-b016-8ab4fef33d6b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:18.730319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4273ae1f-dbf9-49fc-b016-8ab4fef33d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:18.837627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:18.845924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32cd2a-b57b-4e95-a85f-49497a4a4438 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:18.850654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 117/226] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:18.878390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273ae1f-dbf9-49fc-b016-8ab4fef33d6b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:18.914443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb743e19-5d24-4849-a056-ccc0648c9209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:18.916411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb743e19-5d24-4849-a056-ccc0648c9209 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:18.917176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb743e19-5d24-4849-a056-ccc0648c9209 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:18.917658 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb743e19-5d24-4849-a056-ccc0648c9209 None admin] PATH_INFO: `/v3/users/178874e85c2642b596b90cfa5a89d04d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:18.922931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb743e19-5d24-4849-a056-ccc0648c9209 None admin] RBAC: Authorizing `identity:get_user(user_id=178874e85c2642b596b90cfa5a89d04d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:18.924797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb743e19-5d24-4849-a056-ccc0648c9209 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:18.926926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 110/227] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:18 2022] GET /identity/v3/users/178874e85c2642b596b90cfa5a89d04d => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:18.932852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb743e19-5d24-4849-a056-ccc0648c9209 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:18.995347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273ae1f-dbf9-49fc-b016-8ab4fef33d6b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:19.033649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768151eb-d161-4e08-9504-e213dcd36166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:19.034504 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768151eb-d161-4e08-9504-e213dcd36166 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:19.034797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768151eb-d161-4e08-9504-e213dcd36166 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:19.035404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768151eb-d161-4e08-9504-e213dcd36166 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:19.048384 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768151eb-d161-4e08-9504-e213dcd36166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-768151eb-d161-4e08-9504-e213dcd36166 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:19.060123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:19.061314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:19.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:19.066286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 118/228] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:19.069573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768151eb-d161-4e08-9504-e213dcd36166 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:19.128873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:19.179173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768151eb-d161-4e08-9504-e213dcd36166 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:19.179773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:19.224044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6ace1-c94f-49a4-9e7d-f8bcb6bef716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:19.224846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ace1-c94f-49a4-9e7d-f8bcb6bef716 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:19.225147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ace1-c94f-49a4-9e7d-f8bcb6bef716 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:19.225435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6ace1-c94f-49a4-9e7d-f8bcb6bef716 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:19.226237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6ace1-c94f-49a4-9e7d-f8bcb6bef716 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:19.226561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6ace1-c94f-49a4-9e7d-f8bcb6bef716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:19.228732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6ace1-c94f-49a4-9e7d-f8bcb6bef716 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:19.237324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 119/229] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:19.237472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb743e19-5d24-4849-a056-ccc0648c9209 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:19.242717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6ace1-c94f-49a4-9e7d-f8bcb6bef716 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:19.302031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c6af4-df69-4a25-bb6f-f17611c2142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:19.302991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6af4-df69-4a25-bb6f-f17611c2142e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:19.303280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6af4-df69-4a25-bb6f-f17611c2142e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:19.303557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6af4-df69-4a25-bb6f-f17611c2142e None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:19.307813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c6af4-df69-4a25-bb6f-f17611c2142e None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:19.309291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c6af4-df69-4a25-bb6f-f17611c2142e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:19.311084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 111/230] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:18 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:19.316928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c6af4-df69-4a25-bb6f-f17611c2142e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:19.420379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c6af4-df69-4a25-bb6f-f17611c2142e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:19.436708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6ace1-c94f-49a4-9e7d-f8bcb6bef716 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:19.466512 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:19.487503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c0be0-8247-4db9-bce0-deb8b4500eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:19.488416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0be0-8247-4db9-bce0-deb8b4500eab None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:19.488696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0be0-8247-4db9-bce0-deb8b4500eab None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:19.488971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0be0-8247-4db9-bce0-deb8b4500eab None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/users/178874e85c2642b596b90cfa5a89d04d/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:19.492643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c0be0-8247-4db9-bce0-deb8b4500eab None admin] RBAC: Authorizing `identity:create_grant(project_id=bf2fd0aef6ed4a1b97eab01228b80cac, user_id=178874e85c2642b596b90cfa5a89d04d, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:19.494418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c0be0-8247-4db9-bce0-deb8b4500eab None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:19.504001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea581f-4a7a-4241-9c5b-ad9657f14280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:19.504898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea581f-4a7a-4241-9c5b-ad9657f14280 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:19.505188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea581f-4a7a-4241-9c5b-ad9657f14280 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:19.505480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea581f-4a7a-4241-9c5b-ad9657f14280 None admin] PATH_INFO: `/v3/users/178874e85c2642b596b90cfa5a89d04d` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:19.508010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea581f-4a7a-4241-9c5b-ad9657f14280 None admin] RBAC: Authorizing `identity:get_user(user_id=178874e85c2642b596b90cfa5a89d04d)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:19.510466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea581f-4a7a-4241-9c5b-ad9657f14280 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:19.518459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 120/231] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:19 2022] GET /identity/v3/users/178874e85c2642b596b90cfa5a89d04d => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:19.519747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea581f-4a7a-4241-9c5b-ad9657f14280 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:19.520265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 112/232] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 13:59:19 2022] PUT /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/users/178874e85c2642b596b90cfa5a89d04d/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:19.652297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea581f-4a7a-4241-9c5b-ad9657f14280 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:19.691308 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b18cc8-9dea-4363-bade-dc2fb0c7ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:19.692122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18cc8-9dea-4363-bade-dc2fb0c7ac79 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:19.692414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18cc8-9dea-4363-bade-dc2fb0c7ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:19.692699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b18cc8-9dea-4363-bade-dc2fb0c7ac79 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:19.694046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b18cc8-9dea-4363-bade-dc2fb0c7ac79 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:19.695556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b18cc8-9dea-4363-bade-dc2fb0c7ac79 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:19.697744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 121/233] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:19 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:19.707331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c0be0-8247-4db9-bce0-deb8b4500eab None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:19.734368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:19.866255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c0be0-8247-4db9-bce0-deb8b4500eab None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:19.920740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f661f-64d4-4816-b4b1-bd1c67059cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:19.922009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f661f-64d4-4816-b4b1-bd1c67059cb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:19.922530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f661f-64d4-4816-b4b1-bd1c67059cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:19.923014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f661f-64d4-4816-b4b1-bd1c67059cb6 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/users/178874e85c2642b596b90cfa5a89d04d/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:19.925526 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f661f-64d4-4816-b4b1-bd1c67059cb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf2fd0aef6ed4a1b97eab01228b80cac, user_id=178874e85c2642b596b90cfa5a89d04d, role_id=a9fb1d2d70d24a29a0fad5800c9ea0f7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:19.927230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f661f-64d4-4816-b4b1-bd1c67059cb6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:19.930937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0d776-4203-4779-8ef6-ad09000aa64a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:19.931266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0d776-4203-4779-8ef6-ad09000aa64a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:19.931806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0d776-4203-4779-8ef6-ad09000aa64a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:19.933517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 122/234] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:19.939047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8611a5-b2f6-4b98-973b-508c6bc5c465 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:19.939601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8611a5-b2f6-4b98-973b-508c6bc5c465 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:19.940080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8611a5-b2f6-4b98-973b-508c6bc5c465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:19.955700 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 113/235] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 13:59:19 2022] PUT /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/users/178874e85c2642b596b90cfa5a89d04d/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:19.964128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-dc8611a5-b2f6-4b98-973b-508c6bc5c465 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:19.965824 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-dc8611a5-b2f6-4b98-973b-508c6bc5c465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:20.020868 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2a0b-68ee-4a2e-99a9-9256e35a789f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:20.021518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2a0b-68ee-4a2e-99a9-9256e35a789f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:20.022085 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f2a0b-68ee-4a2e-99a9-9256e35a789f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:20.023831 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 114/236] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:20.030420 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0e57-f481-4b78-9a81-63b06b385b13 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:20.031042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0e57-f481-4b78-9a81-63b06b385b13 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:20.031519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0e57-f481-4b78-9a81-63b06b385b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:20.038752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:20.052584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8fcb0e57-f481-4b78-9a81-63b06b385b13 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:20.054210 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8fcb0e57-f481-4b78-9a81-63b06b385b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:20.092232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 123/237] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:20.137065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8611a5-b2f6-4b98-973b-508c6bc5c465 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:20.162134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:20.173402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 115/238] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:20.201711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb0e57-f481-4b78-9a81-63b06b385b13 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:20.264689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8611a5-b2f6-4b98-973b-508c6bc5c465 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:20.301826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245ad4d-9abe-48f0-8546-de974538806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:20.302752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245ad4d-9abe-48f0-8546-de974538806f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:20.302951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245ad4d-9abe-48f0-8546-de974538806f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:20.303225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245ad4d-9abe-48f0-8546-de974538806f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:20.314410 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245ad4d-9abe-48f0-8546-de974538806f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-1245ad4d-9abe-48f0-8546-de974538806f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:20.323096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:20.324149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:20.325011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 124/239] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:20.334191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245ad4d-9abe-48f0-8546-de974538806f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:20.336790 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb0e57-f481-4b78-9a81-63b06b385b13 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:20.410766 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2470-57f1-4730-827b-f84878b7942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:20.411685 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2470-57f1-4730-827b-f84878b7942e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:20.411970 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2470-57f1-4730-827b-f84878b7942e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:20.412248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2470-57f1-4730-827b-f84878b7942e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:20.413581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c2470-57f1-4730-827b-f84878b7942e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:20.415055 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c2470-57f1-4730-827b-f84878b7942e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:20.417513 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 116/240] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:20.422736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2470-57f1-4730-827b-f84878b7942e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:20.442674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:20.547473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:20.585939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245ad4d-9abe-48f0-8546-de974538806f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:20.591703 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2470-57f1-4730-827b-f84878b7942e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:20.643317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cafd01-be98-487c-be92-3a55e2dc37e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:20.643999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cafd01-be98-487c-be92-3a55e2dc37e5 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:20.644282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cafd01-be98-487c-be92-3a55e2dc37e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:20.644554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cafd01-be98-487c-be92-3a55e2dc37e5 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:20.645535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cafd01-be98-487c-be92-3a55e2dc37e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:20.647015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cafd01-be98-487c-be92-3a55e2dc37e5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:20.672021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e6610-e8a4-40a0-b6ef-473b4fe8bf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:20.673000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6610-e8a4-40a0-b6ef-473b4fe8bf04 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:20.674182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6610-e8a4-40a0-b6ef-473b4fe8bf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:20.675421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6610-e8a4-40a0-b6ef-473b4fe8bf04 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:20.677568 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e6610-e8a4-40a0-b6ef-473b4fe8bf04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:20.677897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e6610-e8a4-40a0-b6ef-473b4fe8bf04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:20.680557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e6610-e8a4-40a0-b6ef-473b4fe8bf04 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:20.681858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 117/241] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:59:20 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:20.700036 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 125/242] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:20.703304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cafd01-be98-487c-be92-3a55e2dc37e5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:20.795042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693f02-3687-4015-b26e-4f9a47d11bd4 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:20.795353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693f02-3687-4015-b26e-4f9a47d11bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:20.795610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a693f02-3687-4015-b26e-4f9a47d11bd4 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:20.797251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 126/243] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:20.802633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0ec4d-a5de-4d4c-b73e-0975f0f15355 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:20.802855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0ec4d-a5de-4d4c-b73e-0975f0f15355 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:20.803133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0ec4d-a5de-4d4c-b73e-0975f0f15355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:20.820030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cafd01-be98-487c-be92-3a55e2dc37e5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:20.820654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-94b0ec4d-a5de-4d4c-b73e-0975f0f15355 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:20.822956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-94b0ec4d-a5de-4d4c-b73e-0975f0f15355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:20.858614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:20.872504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83d570-fd16-44c6-b7d6-a942a2a91cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:20.875112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83d570-fd16-44c6-b7d6-a942a2a91cdc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:20.875404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83d570-fd16-44c6-b7d6-a942a2a91cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:20.875684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83d570-fd16-44c6-b7d6-a942a2a91cdc None admin] PATH_INFO: `/v3/users/5b2d785261bc4b53a4e069cdab9be974` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:20.911836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83d570-fd16-44c6-b7d6-a942a2a91cdc None admin] RBAC: Authorizing `identity:get_user(user_id=5b2d785261bc4b53a4e069cdab9be974)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:20.913373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83d570-fd16-44c6-b7d6-a942a2a91cdc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:20.925565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 118/244] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:20 2022] GET /identity/v3/users/5b2d785261bc4b53a4e069cdab9be974 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:20.933570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83d570-fd16-44c6-b7d6-a942a2a91cdc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:20.960802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 127/245] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:20.986133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0ec4d-a5de-4d4c-b73e-0975f0f15355 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:21.037619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:21.074507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83d570-fd16-44c6-b7d6-a942a2a91cdc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:21.134336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc0a99-55cb-4ff7-9cf7-ac75f05f68c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:21.135357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0a99-55cb-4ff7-9cf7-ac75f05f68c1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:21.135859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0a99-55cb-4ff7-9cf7-ac75f05f68c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:21.136330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0a99-55cb-4ff7-9cf7-ac75f05f68c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:21.149014 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0ec4d-a5de-4d4c-b73e-0975f0f15355 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:21.191568 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:21.194331 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65daef-b6b0-4433-b225-ce9e45fd6b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:21.195163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65daef-b6b0-4433-b225-ce9e45fd6b17 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:21.195453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65daef-b6b0-4433-b225-ce9e45fd6b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:21.195735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65daef-b6b0-4433-b225-ce9e45fd6b17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:21.208222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65daef-b6b0-4433-b225-ce9e45fd6b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-cb65daef-b6b0-4433-b225-ce9e45fd6b17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:21.222178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:21.223145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:21.224039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:21.224654 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc0a99-55cb-4ff7-9cf7-ac75f05f68c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:21.225041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 128/246] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:21.225112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc0a99-55cb-4ff7-9cf7-ac75f05f68c1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:21.225178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65daef-b6b0-4433-b225-ce9e45fd6b17 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:21.326615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 119/247] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:21.335334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:21.336339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc0a99-55cb-4ff7-9cf7-ac75f05f68c1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:21.346296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65daef-b6b0-4433-b225-ce9e45fd6b17 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:21.389022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb85556-5137-4fe4-aa2b-17cc5e50c413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:21.389832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85556-5137-4fe4-aa2b-17cc5e50c413 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:21.390131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85556-5137-4fe4-aa2b-17cc5e50c413 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:21.390475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb85556-5137-4fe4-aa2b-17cc5e50c413 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:21.391260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb85556-5137-4fe4-aa2b-17cc5e50c413 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:21.391582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb85556-5137-4fe4-aa2b-17cc5e50c413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:21.393118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb85556-5137-4fe4-aa2b-17cc5e50c413 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:21.404197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 129/248] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:21.409687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb85556-5137-4fe4-aa2b-17cc5e50c413 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:21.439528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:21.470896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc0a99-55cb-4ff7-9cf7-ac75f05f68c1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:21.515265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88146a-bb04-4544-b902-85e90ec31130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:21.516279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88146a-bb04-4544-b902-85e90ec31130 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:21.516574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88146a-bb04-4544-b902-85e90ec31130 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:21.516855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88146a-bb04-4544-b902-85e90ec31130 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:21.518094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88146a-bb04-4544-b902-85e90ec31130 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:21.519595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88146a-bb04-4544-b902-85e90ec31130 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:21.521610 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 120/249] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:21 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:21.528213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88146a-bb04-4544-b902-85e90ec31130 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:21.550707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb85556-5137-4fe4-aa2b-17cc5e50c413 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:21.590983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed2f3-2509-4e14-b9dc-44fe491729b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:21.591795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed2f3-2509-4e14-b9dc-44fe491729b0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:21.592084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed2f3-2509-4e14-b9dc-44fe491729b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:21.592366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ed2f3-2509-4e14-b9dc-44fe491729b0 None admin] PATH_INFO: `/v3/users/416d33fdb9ed429b909dd3940494f8c2` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:21.593604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ed2f3-2509-4e14-b9dc-44fe491729b0 None admin] RBAC: Authorizing `identity:get_user(user_id=416d33fdb9ed429b909dd3940494f8c2)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:21.595102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ed2f3-2509-4e14-b9dc-44fe491729b0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:21.597075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 130/250] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:21 2022] GET /identity/v3/users/416d33fdb9ed429b909dd3940494f8c2 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:21.602062 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed2f3-2509-4e14-b9dc-44fe491729b0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:21.646858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:21.693503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88146a-bb04-4544-b902-85e90ec31130 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:21.761905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0486cd-6b62-4fcd-a08f-b7421a9c3f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:21.762610 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0486cd-6b62-4fcd-a08f-b7421a9c3f33 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:21.762897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0486cd-6b62-4fcd-a08f-b7421a9c3f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:21.763177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0486cd-6b62-4fcd-a08f-b7421a9c3f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:21.764031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0486cd-6b62-4fcd-a08f-b7421a9c3f33 None admin] RBAC: Adding query filter params (role.id=07eba1cca2a34e7bbde6d6a82772b4ae, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac, user.id=5b2d785261bc4b53a4e069cdab9be974) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:21.764348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0486cd-6b62-4fcd-a08f-b7421a9c3f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:21.765813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0486cd-6b62-4fcd-a08f-b7421a9c3f33 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:21.782622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 121/251] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:21 2022] GET /identity/v3/role_assignments?user.id=5b2d785261bc4b53a4e069cdab9be974&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=07eba1cca2a34e7bbde6d6a82772b4ae => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:21.795422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ed2f3-2509-4e14-b9dc-44fe491729b0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:21.838185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4212e4-c7c2-43c7-852e-b901eeb6f8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:21.839111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4212e4-c7c2-43c7-852e-b901eeb6f8ca None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:21.839399 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4212e4-c7c2-43c7-852e-b901eeb6f8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:21.839678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4212e4-c7c2-43c7-852e-b901eeb6f8ca None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:21.841043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4212e4-c7c2-43c7-852e-b901eeb6f8ca None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:21.842517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4212e4-c7c2-43c7-852e-b901eeb6f8ca None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:21.848970 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 131/252] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:21 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:21.849995 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0486cd-6b62-4fcd-a08f-b7421a9c3f33 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:21.867731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:21.992641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0486cd-6b62-4fcd-a08f-b7421a9c3f33 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:22.034995 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58830ac-35d3-42a0-b52a-56e67cbfb858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:22.035939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58830ac-35d3-42a0-b52a-56e67cbfb858 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:22.036186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58830ac-35d3-42a0-b52a-56e67cbfb858 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:22.036462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58830ac-35d3-42a0-b52a-56e67cbfb858 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/users/416d33fdb9ed429b909dd3940494f8c2/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:22.043506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58830ac-35d3-42a0-b52a-56e67cbfb858 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf2fd0aef6ed4a1b97eab01228b80cac, user_id=416d33fdb9ed429b909dd3940494f8c2, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:22.044983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58830ac-35d3-42a0-b52a-56e67cbfb858 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:22.059343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 122/253] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 13:59:21 2022] PUT /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/users/416d33fdb9ed429b909dd3940494f8c2/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:22.392368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73495c21-b5ba-4687-af6e-a2faa83780cf None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:22.392756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73495c21-b5ba-4687-af6e-a2faa83780cf None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:22.392935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73495c21-b5ba-4687-af6e-a2faa83780cf None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:22.394613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 132/254] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:22.400607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a372561-a6c8-4696-b43c-fb5f354c9a58 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:22.401107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a372561-a6c8-4696-b43c-fb5f354c9a58 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:22.401452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a372561-a6c8-4696-b43c-fb5f354c9a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:22.427530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5a372561-a6c8-4696-b43c-fb5f354c9a58 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:22.428742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5a372561-a6c8-4696-b43c-fb5f354c9a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:22.508463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 123/255] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:22.549816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73495c21-b5ba-4687-af6e-a2faa83780cf None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:22.667609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:22.686857 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73495c21-b5ba-4687-af6e-a2faa83780cf None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:22.732727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59837ac-e4c8-4567-9348-32ff371a5b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:22.733539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59837ac-e4c8-4567-9348-32ff371a5b52 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:22.733826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59837ac-e4c8-4567-9348-32ff371a5b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:22.734105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59837ac-e4c8-4567-9348-32ff371a5b52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:22.753006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59837ac-e4c8-4567-9348-32ff371a5b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b59837ac-e4c8-4567-9348-32ff371a5b52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:22.761310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:22.762864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:22.763959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 133/256] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:59:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:22.768255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a372561-a6c8-4696-b43c-fb5f354c9a58 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:22.770727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:22.841052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d190422-d2db-446f-a536-e1e555f986de None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:22.841619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d190422-d2db-446f-a536-e1e555f986de None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:22.842096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d190422-d2db-446f-a536-e1e555f986de None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:22.843710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 134/257] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:22.863255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358494db-6c21-475a-9c29-58582f15c547 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:22.863865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358494db-6c21-475a-9c29-58582f15c547 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:22.864319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358494db-6c21-475a-9c29-58582f15c547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:22.890753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-358494db-6c21-475a-9c29-58582f15c547 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:22.893816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-358494db-6c21-475a-9c29-58582f15c547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:22.927639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a372561-a6c8-4696-b43c-fb5f354c9a58 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:22.994888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9890-f84e-49da-b55a-917c3b5a2a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:22.995578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9890-f84e-49da-b55a-917c3b5a2a7b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:22.995865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9890-f84e-49da-b55a-917c3b5a2a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:22.996141 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9890-f84e-49da-b55a-917c3b5a2a7b None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:22.996908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f9890-f84e-49da-b55a-917c3b5a2a7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:22.997217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f9890-f84e-49da-b55a-917c3b5a2a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:22.998640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f9890-f84e-49da-b55a-917c3b5a2a7b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:23.018969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 124/258] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:23.030415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9890-f84e-49da-b55a-917c3b5a2a7b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:23.035337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 135/259] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:23.124646 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:23.134575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358494db-6c21-475a-9c29-58582f15c547 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:23.167969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9890-f84e-49da-b55a-917c3b5a2a7b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:23.230894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca898a-88dc-49bd-a6a5-4ea2865c4f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:23.231883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca898a-88dc-49bd-a6a5-4ea2865c4f54 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:23.232084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca898a-88dc-49bd-a6a5-4ea2865c4f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:23.232366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca898a-88dc-49bd-a6a5-4ea2865c4f54 None admin] PATH_INFO: `/v3/users/178874e85c2642b596b90cfa5a89d04d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:23.238879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca898a-88dc-49bd-a6a5-4ea2865c4f54 None admin] RBAC: Authorizing `identity:get_user(user_id=178874e85c2642b596b90cfa5a89d04d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:23.240406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca898a-88dc-49bd-a6a5-4ea2865c4f54 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:23.242326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 125/260] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:23 2022] GET /identity/v3/users/178874e85c2642b596b90cfa5a89d04d => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:23.247616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca898a-88dc-49bd-a6a5-4ea2865c4f54 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:23.325830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:23.386519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358494db-6c21-475a-9c29-58582f15c547 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:23.451268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327b1b-752a-4e43-86e0-1639d474f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:23.452484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327b1b-752a-4e43-86e0-1639d474f65f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:23.452974 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327b1b-752a-4e43-86e0-1639d474f65f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:23.453449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327b1b-752a-4e43-86e0-1639d474f65f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:23.471783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f327b1b-752a-4e43-86e0-1639d474f65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-2f327b1b-752a-4e43-86e0-1639d474f65f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:23.485649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:23.486677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:23.487528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:23.490381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 136/261] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:23.496103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327b1b-752a-4e43-86e0-1639d474f65f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:23.501963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca898a-88dc-49bd-a6a5-4ea2865c4f54 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:23.549084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:23.568292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6ecf7-37a1-43cf-b34c-ed70445a6b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:23.568969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6ecf7-37a1-43cf-b34c-ed70445a6b0a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:23.569253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6ecf7-37a1-43cf-b34c-ed70445a6b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:23.569811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6ecf7-37a1-43cf-b34c-ed70445a6b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:23.634145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327b1b-752a-4e43-86e0-1639d474f65f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:23.673988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a5d1b-8137-45dc-abc1-e3a81bbb9424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:23.675505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a5d1b-8137-45dc-abc1-e3a81bbb9424 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:23.676012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a5d1b-8137-45dc-abc1-e3a81bbb9424 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:23.676508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a5d1b-8137-45dc-abc1-e3a81bbb9424 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:23.677537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a5d1b-8137-45dc-abc1-e3a81bbb9424 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:23.678049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a5d1b-8137-45dc-abc1-e3a81bbb9424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:23.679696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a5d1b-8137-45dc-abc1-e3a81bbb9424 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:23.685978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:23.692499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 137/262] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:23.699443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a5d1b-8137-45dc-abc1-e3a81bbb9424 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:23.764329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6ecf7-37a1-43cf-b34c-ed70445a6b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:23.765848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6ecf7-37a1-43cf-b34c-ed70445a6b0a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:23.900635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a5d1b-8137-45dc-abc1-e3a81bbb9424 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:23.940580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd13182-b4b1-484a-8c28-894e7d39d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:23.941889 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd13182-b4b1-484a-8c28-894e7d39d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:23.942435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd13182-b4b1-484a-8c28-894e7d39d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:23.942987 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd13182-b4b1-484a-8c28-894e7d39d2d8 None admin] PATH_INFO: `/v3/users/178874e85c2642b596b90cfa5a89d04d` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:23.945308 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd13182-b4b1-484a-8c28-894e7d39d2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=178874e85c2642b596b90cfa5a89d04d)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:23.947590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd13182-b4b1-484a-8c28-894e7d39d2d8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:23.949924 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 138/263] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:23 2022] GET /identity/v3/users/178874e85c2642b596b90cfa5a89d04d => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:23.955990 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd13182-b4b1-484a-8c28-894e7d39d2d8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:24.069175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 126/264] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 13:59:24.074640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6ecf7-37a1-43cf-b34c-ed70445a6b0a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:24.090300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:24.135268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd13182-b4b1-484a-8c28-894e7d39d2d8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:24.163595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:24.182659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429a55-fa63-4a50-9086-9e4a9192d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:24.183690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429a55-fa63-4a50-9086-9e4a9192d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:24.184186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429a55-fa63-4a50-9086-9e4a9192d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:24.184668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4429a55-fa63-4a50-9086-9e4a9192d1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:24.284935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4429a55-fa63-4a50-9086-9e4a9192d1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:24.286910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4429a55-fa63-4a50-9086-9e4a9192d1c9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:24.310370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6ecf7-37a1-43cf-b34c-ed70445a6b0a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:24.361383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:24.368958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12598-e05e-4f60-a74d-d6ad9f4d7f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:24.369823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12598-e05e-4f60-a74d-d6ad9f4d7f3a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:24.370050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12598-e05e-4f60-a74d-d6ad9f4d7f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:24.370357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca12598-e05e-4f60-a74d-d6ad9f4d7f3a None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:24.374950 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca12598-e05e-4f60-a74d-d6ad9f4d7f3a None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:24.376437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca12598-e05e-4f60-a74d-d6ad9f4d7f3a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:24.378552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 127/265] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:24 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:24.383976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12598-e05e-4f60-a74d-d6ad9f4d7f3a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:24.406302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 139/266] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:24.434096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429a55-fa63-4a50-9086-9e4a9192d1c9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:24.542981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:24.549073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca12598-e05e-4f60-a74d-d6ad9f4d7f3a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:24.557385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4429a55-fa63-4a50-9086-9e4a9192d1c9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:24.591851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146f7a6-ed99-4828-97ec-5db0ff309a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:24.592502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f7a6-ed99-4828-97ec-5db0ff309a44 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:24.592791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f7a6-ed99-4828-97ec-5db0ff309a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:24.593055 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146f7a6-ed99-4828-97ec-5db0ff309a44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:24.593895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146f7a6-ed99-4828-97ec-5db0ff309a44 None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac, user.id=178874e85c2642b596b90cfa5a89d04d) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:24.594232 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146f7a6-ed99-4828-97ec-5db0ff309a44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:24.595670 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146f7a6-ed99-4828-97ec-5db0ff309a44 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:24.597737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf59cca-a9fa-440f-8c91-99ae6b748603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:24.598969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59cca-a9fa-440f-8c91-99ae6b748603 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:24.599448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59cca-a9fa-440f-8c91-99ae6b748603 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:24.600061 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59cca-a9fa-440f-8c91-99ae6b748603 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:24.601426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf59cca-a9fa-440f-8c91-99ae6b748603 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:24.601759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 128/267] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:24 2022] GET /identity/v3/role_assignments?user.id=178874e85c2642b596b90cfa5a89d04d&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=57f1335a97b5490cb0853894c2faf62c => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:24.603757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf59cca-a9fa-440f-8c91-99ae6b748603 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:24.603883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e128c-b49d-455a-b48a-289628451113 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:24.604053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e128c-b49d-455a-b48a-289628451113 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:24.604333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e128c-b49d-455a-b48a-289628451113 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:24.606075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 140/268] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:24 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:24.607565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7eeb-1ebe-4cd9-85b3-48fb5bcceafa None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:24.608030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7eeb-1ebe-4cd9-85b3-48fb5bcceafa None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:24.608456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7eeb-1ebe-4cd9-85b3-48fb5bcceafa None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:24.609879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 129/269] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:24.610183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 141/270] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:24.614307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0662-b625-4eb6-a777-0a5a7fdc6757 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:24.614307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0662-b625-4eb6-a777-0a5a7fdc6757 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:24.614307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0662-b625-4eb6-a777-0a5a7fdc6757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:24.615462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f7eeb-1ebe-4cd9-85b3-48fb5bcceafa None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:24.632291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-51ee0662-b625-4eb6-a777-0a5a7fdc6757 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:24.633808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-51ee0662-b625-4eb6-a777-0a5a7fdc6757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:24.661386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:24.713884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 130/271] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:24.715485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674d63c-6839-4168-a403-ec13f2bdb11c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:24.715781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674d63c-6839-4168-a403-ec13f2bdb11c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:24.716059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674d63c-6839-4168-a403-ec13f2bdb11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:24.739409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a674d63c-6839-4168-a403-ec13f2bdb11c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:24.740634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a674d63c-6839-4168-a403-ec13f2bdb11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:24.747753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f7eeb-1ebe-4cd9-85b3-48fb5bcceafa None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:24.798283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9200d-4c50-4057-8dee-98f159303144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:24.799453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9200d-4c50-4057-8dee-98f159303144 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:24.800173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9200d-4c50-4057-8dee-98f159303144 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:24.800715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9200d-4c50-4057-8dee-98f159303144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:24.801954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9200d-4c50-4057-8dee-98f159303144 None admin] RBAC: Adding query filter params (role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac, user.id=178874e85c2642b596b90cfa5a89d04d) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:24.802548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9200d-4c50-4057-8dee-98f159303144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:24.804433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9200d-4c50-4057-8dee-98f159303144 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:24.812677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 142/272] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:24 2022] GET /identity/v3/role_assignments?user.id=178874e85c2642b596b90cfa5a89d04d&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:24.813778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9200d-4c50-4057-8dee-98f159303144 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:24.843944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 131/273] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:24.871129 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8d5b-e3bb-475b-8a7a-0f252d690a3e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:24.871506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8d5b-e3bb-475b-8a7a-0f252d690a3e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:24.871905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8d5b-e3bb-475b-8a7a-0f252d690a3e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:24.873780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 132/274] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:24.880692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2f46d-1d9a-41c7-b8da-d3195c44a7ad None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:24.880984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2f46d-1d9a-41c7-b8da-d3195c44a7ad None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:24.881407 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2f46d-1d9a-41c7-b8da-d3195c44a7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:24.901345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f6d2f46d-1d9a-41c7-b8da-d3195c44a7ad None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:24.902718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f6d2f46d-1d9a-41c7-b8da-d3195c44a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:24.930639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:24.974066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:24.980496 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9200d-4c50-4057-8dee-98f159303144 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:24.997470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 133/275] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:24.998757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2f46d-1d9a-41c7-b8da-d3195c44a7ad None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:25.048104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d2f92-b6c0-4856-9805-7cfce9d8419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:25.048958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d2f92-b6c0-4856-9805-7cfce9d8419b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.049242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d2f92-b6c0-4856-9805-7cfce9d8419b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.049521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d2f92-b6c0-4856-9805-7cfce9d8419b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.050771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d2f92-b6c0-4856-9805-7cfce9d8419b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:25.052240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d2f92-b6c0-4856-9805-7cfce9d8419b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:25.054550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 143/276] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:25.055413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d2f92-b6c0-4856-9805-7cfce9d8419b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:25.133430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2f46d-1d9a-41c7-b8da-d3195c44a7ad None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:25.178088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d2f92-b6c0-4856-9805-7cfce9d8419b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:25.180081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5190e1-4ad8-49db-99b8-1812a16ea99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:25.182404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5190e1-4ad8-49db-99b8-1812a16ea99c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.182692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5190e1-4ad8-49db-99b8-1812a16ea99c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.182969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5190e1-4ad8-49db-99b8-1812a16ea99c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.195781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5190e1-4ad8-49db-99b8-1812a16ea99c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3f5190e1-4ad8-49db-99b8-1812a16ea99c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:25.206301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:25.207253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:25.208139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:25.208744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 134/277] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:25.209937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5190e1-4ad8-49db-99b8-1812a16ea99c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:25.222832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659efcd-2607-469d-9889-3cb7157c6965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:25.224204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659efcd-2607-469d-9889-3cb7157c6965 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.224437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659efcd-2607-469d-9889-3cb7157c6965 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.224828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659efcd-2607-469d-9889-3cb7157c6965 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.230779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:25.239611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659efcd-2607-469d-9889-3cb7157c6965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-3659efcd-2607-469d-9889-3cb7157c6965 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:25.247853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:25.248752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 144/278] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:25.254863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659efcd-2607-469d-9889-3cb7157c6965 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:25.284028 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:25.336155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5190e1-4ad8-49db-99b8-1812a16ea99c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:25.359615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659efcd-2607-469d-9889-3cb7157c6965 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:25.372208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad107b31-b61c-413b-9473-e12e3553a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:25.372893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad107b31-b61c-413b-9473-e12e3553a6fd None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.373178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad107b31-b61c-413b-9473-e12e3553a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.373457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad107b31-b61c-413b-9473-e12e3553a6fd None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.374198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad107b31-b61c-413b-9473-e12e3553a6fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:25.375740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad107b31-b61c-413b-9473-e12e3553a6fd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:25.395973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a65ef5-deea-4fdd-9746-6656b7da9880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:25.396507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 135/279] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:59:25 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:25.396667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a65ef5-deea-4fdd-9746-6656b7da9880 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.396954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a65ef5-deea-4fdd-9746-6656b7da9880 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.397250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a65ef5-deea-4fdd-9746-6656b7da9880 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.397350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad107b31-b61c-413b-9473-e12e3553a6fd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:25.397981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a65ef5-deea-4fdd-9746-6656b7da9880 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:25.398318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a65ef5-deea-4fdd-9746-6656b7da9880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:25.400049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a65ef5-deea-4fdd-9746-6656b7da9880 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:25.411456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 145/280] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:25.416481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af7058-1723-4596-8643-5a182eff49d9 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.416759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af7058-1723-4596-8643-5a182eff49d9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.417031 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af7058-1723-4596-8643-5a182eff49d9 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.418671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 146/281] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:25.419371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af7058-1723-4596-8643-5a182eff49d9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:25.490431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:25.528194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad107b31-b61c-413b-9473-e12e3553a6fd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:25.536714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:25.550462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af7058-1723-4596-8643-5a182eff49d9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:25.570282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9965cc-024b-48cd-a050-89143ad17e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:25.571230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9965cc-024b-48cd-a050-89143ad17e4b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.572751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9965cc-024b-48cd-a050-89143ad17e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.572751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9965cc-024b-48cd-a050-89143ad17e4b None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.573802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9965cc-024b-48cd-a050-89143ad17e4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:25.573802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9965cc-024b-48cd-a050-89143ad17e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:25.575237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9965cc-024b-48cd-a050-89143ad17e4b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:25.584852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 136/282] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:25.591603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bf746-53ae-4411-a343-59ddcd4a089f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:25.592602 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf746-53ae-4411-a343-59ddcd4a089f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.592826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf746-53ae-4411-a343-59ddcd4a089f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.593151 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf746-53ae-4411-a343-59ddcd4a089f None admin] PATH_INFO: `/v3/users/b0dbcc9b77d54e249a6563cbd16110b7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.595744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc71c2-176a-446a-ac8f-db3b33afbfad None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.596244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc71c2-176a-446a-ac8f-db3b33afbfad None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.597581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc71c2-176a-446a-ac8f-db3b33afbfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.614094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bf746-53ae-4411-a343-59ddcd4a089f None admin] RBAC: Authorizing `identity:get_user(user_id=b0dbcc9b77d54e249a6563cbd16110b7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:25.615950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bf746-53ae-4411-a343-59ddcd4a089f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:25.618982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 147/283] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:25 2022] GET /identity/v3/users/b0dbcc9b77d54e249a6563cbd16110b7 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:25.619345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bf746-53ae-4411-a343-59ddcd4a089f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:25.620615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f2dc71c2-176a-446a-ac8f-db3b33afbfad None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:25.621800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f2dc71c2-176a-446a-ac8f-db3b33afbfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:25.716527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 137/284] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:25.717393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc71c2-176a-446a-ac8f-db3b33afbfad None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:25.756584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bf746-53ae-4411-a343-59ddcd4a089f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:25.794030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:25.815158 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8619bd-7fe9-4384-b9d3-6e21f7cb2f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:25.816717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8619bd-7fe9-4384-b9d3-6e21f7cb2f4c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.817212 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8619bd-7fe9-4384-b9d3-6e21f7cb2f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.818211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8619bd-7fe9-4384-b9d3-6e21f7cb2f4c None admin] PATH_INFO: `/v3/users/5b2d785261bc4b53a4e069cdab9be974` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.819959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8619bd-7fe9-4384-b9d3-6e21f7cb2f4c None admin] RBAC: Authorizing `identity:get_user(user_id=5b2d785261bc4b53a4e069cdab9be974)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:25.822307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8619bd-7fe9-4384-b9d3-6e21f7cb2f4c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:25.825089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 148/285] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:25 2022] GET /identity/v3/users/5b2d785261bc4b53a4e069cdab9be974 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:25.826394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8619bd-7fe9-4384-b9d3-6e21f7cb2f4c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:25.839109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc71c2-176a-446a-ac8f-db3b33afbfad None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:25.854626 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:25.880547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cea36a-b58c-467b-ba7b-5969a59b3389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:25.881251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cea36a-b58c-467b-ba7b-5969a59b3389 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:25.881536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cea36a-b58c-467b-ba7b-5969a59b3389 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:25.881827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cea36a-b58c-467b-ba7b-5969a59b3389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:25.882834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cea36a-b58c-467b-ba7b-5969a59b3389 None admin] RBAC: Adding query filter params (role.id=8b1dade745704cf3a2a92b5ac07853b4, user.id=b0dbcc9b77d54e249a6563cbd16110b7, scope.system=all) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:25.883175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cea36a-b58c-467b-ba7b-5969a59b3389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:25.884810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cea36a-b58c-467b-ba7b-5969a59b3389 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:25.892157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 138/286] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Jul 11 13:59:25 2022] GET /identity/v3/role_assignments?user.id=b0dbcc9b77d54e249a6563cbd16110b7&scope.system=all&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:25.895304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cea36a-b58c-467b-ba7b-5969a59b3389 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:26.012523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8619bd-7fe9-4384-b9d3-6e21f7cb2f4c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:26.065912 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f096559-12a9-41a9-bc75-5c45d63d9546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:26.067132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f096559-12a9-41a9-bc75-5c45d63d9546 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:26.067622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f096559-12a9-41a9-bc75-5c45d63d9546 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:26.068123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f096559-12a9-41a9-bc75-5c45d63d9546 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:26.088052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f096559-12a9-41a9-bc75-5c45d63d9546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-4f096559-12a9-41a9-bc75-5c45d63d9546 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:26.096900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:26.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:26.098709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 149/287] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:26.107611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f096559-12a9-41a9-bc75-5c45d63d9546 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:26.130052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cea36a-b58c-467b-ba7b-5969a59b3389 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:26.170681 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:26.184685 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5a4e3-fd36-4316-b777-373338a18cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:26.185909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5a4e3-fd36-4316-b777-373338a18cda None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:26.186843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5a4e3-fd36-4316-b777-373338a18cda None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:26.188210 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5a4e3-fd36-4316-b777-373338a18cda None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:26.190569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5a4e3-fd36-4316-b777-373338a18cda None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:26.193392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5a4e3-fd36-4316-b777-373338a18cda None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:26.195583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 139/288] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:25 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:26.203571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5a4e3-fd36-4316-b777-373338a18cda None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:26.261697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:26.282619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f096559-12a9-41a9-bc75-5c45d63d9546 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:26.318608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d60f4f-b55b-4032-ab19-5f8af51e9e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:26.319457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d60f4f-b55b-4032-ab19-5f8af51e9e72 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:26.319844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d60f4f-b55b-4032-ab19-5f8af51e9e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:26.320223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d60f4f-b55b-4032-ab19-5f8af51e9e72 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:26.321094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d60f4f-b55b-4032-ab19-5f8af51e9e72 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:26.322080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d60f4f-b55b-4032-ab19-5f8af51e9e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:26.323664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d60f4f-b55b-4032-ab19-5f8af51e9e72 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:26.333109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 150/289] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:26.343214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d60f4f-b55b-4032-ab19-5f8af51e9e72 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:26.399501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5a4e3-fd36-4316-b777-373338a18cda None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:26.448895 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d60f4f-b55b-4032-ab19-5f8af51e9e72 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:26.474726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389f842-cac8-4446-a78f-cb04174886e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:26.475713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389f842-cac8-4446-a78f-cb04174886e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:26.476107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389f842-cac8-4446-a78f-cb04174886e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:26.476395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389f842-cac8-4446-a78f-cb04174886e9 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/users/5b2d785261bc4b53a4e069cdab9be974/roles/07eba1cca2a34e7bbde6d6a82772b4ae` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:26.481679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389f842-cac8-4446-a78f-cb04174886e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf2fd0aef6ed4a1b97eab01228b80cac, user_id=5b2d785261bc4b53a4e069cdab9be974, role_id=07eba1cca2a34e7bbde6d6a82772b4ae)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:26.483210 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389f842-cac8-4446-a78f-cb04174886e9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:26.486446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c8c73-578e-4034-8af4-13b503424296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:26.487542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c8c73-578e-4034-8af4-13b503424296 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:26.487977 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c8c73-578e-4034-8af4-13b503424296 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:26.488403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c8c73-578e-4034-8af4-13b503424296 None admin] PATH_INFO: `/v3/users/416d33fdb9ed429b909dd3940494f8c2` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:26.489781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c8c73-578e-4034-8af4-13b503424296 None admin] RBAC: Authorizing `identity:get_user(user_id=416d33fdb9ed429b909dd3940494f8c2)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:26.491438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c8c73-578e-4034-8af4-13b503424296 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:26.494652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 151/290] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:26 2022] GET /identity/v3/users/416d33fdb9ed429b909dd3940494f8c2 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:26.500244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c8c73-578e-4034-8af4-13b503424296 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:26.512116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:26.514048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 140/291] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 13:59:26 2022] PUT /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/users/5b2d785261bc4b53a4e069cdab9be974/roles/07eba1cca2a34e7bbde6d6a82772b4ae => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:26.625802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c8c73-578e-4034-8af4-13b503424296 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:26.669934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e088d-3625-407b-82f6-d681d47806bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:26.670663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e088d-3625-407b-82f6-d681d47806bd None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:26.670953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e088d-3625-407b-82f6-d681d47806bd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:26.671232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e088d-3625-407b-82f6-d681d47806bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:26.751920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e088d-3625-407b-82f6-d681d47806bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:26.753433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e088d-3625-407b-82f6-d681d47806bd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:26.777740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:26.886563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 152/292] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 13:59:26.891977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389f842-cac8-4446-a78f-cb04174886e9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:26.949078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:27.004947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389f842-cac8-4446-a78f-cb04174886e9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:27.054839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3dd6e8-e4e8-4f6c-8f1d-20b68b536d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:27.056665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dd6e8-e4e8-4f6c-8f1d-20b68b536d17 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:27.057424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dd6e8-e4e8-4f6c-8f1d-20b68b536d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:27.057902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3dd6e8-e4e8-4f6c-8f1d-20b68b536d17 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:27.062893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dd6e8-e4e8-4f6c-8f1d-20b68b536d17 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:27.064597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3dd6e8-e4e8-4f6c-8f1d-20b68b536d17 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:27.066888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 141/293] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:26 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:27.072531 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e088d-3625-407b-82f6-d681d47806bd None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:27.231090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e088d-3625-407b-82f6-d681d47806bd None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:27.247080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:27.280480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133d3c2-a05d-4618-ac12-02a8bfb7507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:27.281156 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133d3c2-a05d-4618-ac12-02a8bfb7507d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:27.281449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133d3c2-a05d-4618-ac12-02a8bfb7507d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:27.281728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133d3c2-a05d-4618-ac12-02a8bfb7507d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:27.282614 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133d3c2-a05d-4618-ac12-02a8bfb7507d None admin] RBAC: Adding query filter params (role.id=8b1dade745704cf3a2a92b5ac07853b4, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac, user.id=416d33fdb9ed429b909dd3940494f8c2) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:27.282932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133d3c2-a05d-4618-ac12-02a8bfb7507d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:27.284380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133d3c2-a05d-4618-ac12-02a8bfb7507d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:27.291934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 153/294] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:27 2022] GET /identity/v3/role_assignments?user.id=416d33fdb9ed429b909dd3940494f8c2&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:27.903511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d43c8-adc2-4903-950e-79fd10df7db6 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:27.904020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d43c8-adc2-4903-950e-79fd10df7db6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:27.904095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d43c8-adc2-4903-950e-79fd10df7db6 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:27.905788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 142/295] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:27.911659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b35e-4fda-4b3c-a438-9040d33043d0 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:27.912090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b35e-4fda-4b3c-a438-9040d33043d0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:27.912286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043b35e-4fda-4b3c-a438-9040d33043d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:27.934415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1043b35e-4fda-4b3c-a438-9040d33043d0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:27.935944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1043b35e-4fda-4b3c-a438-9040d33043d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:28.011591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 154/296] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:28.035504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d43c8-adc2-4903-950e-79fd10df7db6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:28.146478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d43c8-adc2-4903-950e-79fd10df7db6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:28.170974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:28.183430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f76e53-df97-42cb-b0b8-2f266ebee194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:28.184230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f76e53-df97-42cb-b0b8-2f266ebee194 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.184512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f76e53-df97-42cb-b0b8-2f266ebee194 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.184788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f76e53-df97-42cb-b0b8-2f266ebee194 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:28.195104 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f76e53-df97-42cb-b0b8-2f266ebee194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-85f76e53-df97-42cb-b0b8-2f266ebee194 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:28.210724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:28.211697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:28.212724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 143/297] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:28.220440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d81ec5-4e2d-442b-847b-5262b89046f8 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.220440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d81ec5-4e2d-442b-847b-5262b89046f8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.220583 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d81ec5-4e2d-442b-847b-5262b89046f8 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:28.222128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 155/298] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:28.222973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f76e53-df97-42cb-b0b8-2f266ebee194 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:28.228982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d419e-2898-4716-980b-ad91b8607832 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.229270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d419e-2898-4716-980b-ad91b8607832 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.229553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d419e-2898-4716-980b-ad91b8607832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:28.250103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-547d419e-2898-4716-980b-ad91b8607832 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:28.251653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-547d419e-2898-4716-980b-ad91b8607832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:28.340900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 156/299] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:28.354631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdd46-3841-4a32-b360-77c275062647 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.355240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdd46-3841-4a32-b360-77c275062647 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.355830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdd46-3841-4a32-b360-77c275062647 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:28.357762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 157/300] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:28.361762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f76e53-df97-42cb-b0b8-2f266ebee194 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:28.363368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b7020-d2b0-408c-9d6c-480e112001ba None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.363873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b7020-d2b0-408c-9d6c-480e112001ba None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.364349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b7020-d2b0-408c-9d6c-480e112001ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:28.382180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-090b7020-d2b0-408c-9d6c-480e112001ba None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:28.383454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-090b7020-d2b0-408c-9d6c-480e112001ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:28.404428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e95bb-3760-42c1-85d2-fdc3488360fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:28.405113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e95bb-3760-42c1-85d2-fdc3488360fe None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.405497 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e95bb-3760-42c1-85d2-fdc3488360fe None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.405670 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e95bb-3760-42c1-85d2-fdc3488360fe None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:28.406469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e95bb-3760-42c1-85d2-fdc3488360fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:28.406789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e95bb-3760-42c1-85d2-fdc3488360fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:28.408368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e95bb-3760-42c1-85d2-fdc3488360fe None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:28.423721 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 144/301] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:28.423881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:28.423979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e95bb-3760-42c1-85d2-fdc3488360fe None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:28.469514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:28.470878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 158/302] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:28.479883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b7020-d2b0-408c-9d6c-480e112001ba None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:28.532300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e95bb-3760-42c1-85d2-fdc3488360fe None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:28.570298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5b457-39a5-430f-ad1a-3780bc0c62df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:28.571117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5b457-39a5-430f-ad1a-3780bc0c62df None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.571915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5b457-39a5-430f-ad1a-3780bc0c62df None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.572259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5b457-39a5-430f-ad1a-3780bc0c62df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:28.573636 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5b457-39a5-430f-ad1a-3780bc0c62df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:28.575608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5b457-39a5-430f-ad1a-3780bc0c62df None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:28.582634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 145/303] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:28.582634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5b457-39a5-430f-ad1a-3780bc0c62df None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:28.599448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b7020-d2b0-408c-9d6c-480e112001ba None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:28.640041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ddf3-842f-4ada-b3de-33997cf6e6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:28.640933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ddf3-842f-4ada-b3de-33997cf6e6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.641219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ddf3-842f-4ada-b3de-33997cf6e6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.641497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ddf3-842f-4ada-b3de-33997cf6e6d8 None admin] PATH_INFO: `/v3/users/29b40bcb3a264b9498e17328df17f6da` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:28.655643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6ddf3-842f-4ada-b3de-33997cf6e6d8 None admin] RBAC: Authorizing `identity:get_user(user_id=29b40bcb3a264b9498e17328df17f6da)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:28.657131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6ddf3-842f-4ada-b3de-33997cf6e6d8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:28.662283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 159/304] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:28 2022] GET /identity/v3/users/29b40bcb3a264b9498e17328df17f6da => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:28.662283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ddf3-842f-4ada-b3de-33997cf6e6d8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:28.682875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:28.702928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5b457-39a5-430f-ad1a-3780bc0c62df None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:28.715854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:28.737578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96512cae-e9c9-4931-96da-a91eec0c5938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:28.738414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96512cae-e9c9-4931-96da-a91eec0c5938 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.738698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96512cae-e9c9-4931-96da-a91eec0c5938 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.738976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96512cae-e9c9-4931-96da-a91eec0c5938 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:28.750477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96512cae-e9c9-4931-96da-a91eec0c5938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-96512cae-e9c9-4931-96da-a91eec0c5938 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:28.758128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:28.759830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:28.760762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 146/305] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:28.761414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96512cae-e9c9-4931-96da-a91eec0c5938 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:28.780108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ddf3-842f-4ada-b3de-33997cf6e6d8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:28.822263 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5e59-c010-4e27-a547-39631780fb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:28.823124 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5e59-c010-4e27-a547-39631780fb36 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.823413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5e59-c010-4e27-a547-39631780fb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.823701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5e59-c010-4e27-a547-39631780fb36 None admin] PATH_INFO: `/v3/groups` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:28.824407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df5e59-c010-4e27-a547-39631780fb36 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:28.825927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df5e59-c010-4e27-a547-39631780fb36 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:28.841084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 160/306] 10.222.0.66 () {60 vars in 1134 bytes} [Mon Jul 11 13:59:28 2022] POST /identity/v3/groups => generated 229 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:28.852447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5e59-c010-4e27-a547-39631780fb36 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:28.878541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96512cae-e9c9-4931-96da-a91eec0c5938 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:28.921290 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e9cb7-56b3-48cd-bad5-d8994d17bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:28.922920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e9cb7-56b3-48cd-bad5-d8994d17bcdc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.923515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e9cb7-56b3-48cd-bad5-d8994d17bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.923990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e9cb7-56b3-48cd-bad5-d8994d17bcdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:28.925049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e9cb7-56b3-48cd-bad5-d8994d17bcdc None admin] RBAC: Adding query filter params (role.id=07eba1cca2a34e7bbde6d6a82772b4ae, user.id=29b40bcb3a264b9498e17328df17f6da, scope.system=all) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:28.925665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e9cb7-56b3-48cd-bad5-d8994d17bcdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:28.927676 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e9cb7-56b3-48cd-bad5-d8994d17bcdc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:28.935764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 147/307] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Jul 11 13:59:28 2022] GET /identity/v3/role_assignments?user.id=29b40bcb3a264b9498e17328df17f6da&scope.system=all&role.id=07eba1cca2a34e7bbde6d6a82772b4ae => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:28.952424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:28.979709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5e59-c010-4e27-a547-39631780fb36 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:28.998118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892747c-389e-477b-8812-fd92d6d994ce None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:28.998437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892747c-389e-477b-8812-fd92d6d994ce None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:28.998720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892747c-389e-477b-8812-fd92d6d994ce None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:29.000400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 148/308] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:29.008411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd3867-cc22-4045-a034-89f764e23d2b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:29.009935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd3867-cc22-4045-a034-89f764e23d2b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:29.010605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd3867-cc22-4045-a034-89f764e23d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:29.021785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779ad67-37e8-4d72-a43c-7e2eccf30f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:29.022525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779ad67-37e8-4d72-a43c-7e2eccf30f7d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:29.022816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779ad67-37e8-4d72-a43c-7e2eccf30f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:29.023099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779ad67-37e8-4d72-a43c-7e2eccf30f7d None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:29.023927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779ad67-37e8-4d72-a43c-7e2eccf30f7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:29.024249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779ad67-37e8-4d72-a43c-7e2eccf30f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:29.025726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779ad67-37e8-4d72-a43c-7e2eccf30f7d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:29.035314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-36dd3867-cc22-4045-a034-89f764e23d2b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:29.035519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 161/309] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:29.037069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-36dd3867-cc22-4045-a034-89f764e23d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:29.044612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779ad67-37e8-4d72-a43c-7e2eccf30f7d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:29.077077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:29.130182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 149/310] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:29.149178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd3867-cc22-4045-a034-89f764e23d2b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:29.174910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779ad67-37e8-4d72-a43c-7e2eccf30f7d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:29.228190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce5055-61e7-4bd5-91e0-79f6cf8ee1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:29.229273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5055-61e7-4bd5-91e0-79f6cf8ee1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:29.229659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5055-61e7-4bd5-91e0-79f6cf8ee1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:29.230036 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce5055-61e7-4bd5-91e0-79f6cf8ee1a3 None admin] PATH_INFO: `/v3/users/b0dbcc9b77d54e249a6563cbd16110b7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:29.231420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce5055-61e7-4bd5-91e0-79f6cf8ee1a3 None admin] RBAC: Authorizing `identity:get_user(user_id=b0dbcc9b77d54e249a6563cbd16110b7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:29.233486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce5055-61e7-4bd5-91e0-79f6cf8ee1a3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:29.236071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 162/311] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:29 2022] GET /identity/v3/users/b0dbcc9b77d54e249a6563cbd16110b7 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:29.243143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce5055-61e7-4bd5-91e0-79f6cf8ee1a3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:29.260741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd3867-cc22-4045-a034-89f764e23d2b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:29.266507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:29.302515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d4335-bf86-4d27-bd52-8b1a1b44d5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:29.304461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4335-bf86-4d27-bd52-8b1a1b44d5ef None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:29.304907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4335-bf86-4d27-bd52-8b1a1b44d5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:29.305335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4335-bf86-4d27-bd52-8b1a1b44d5ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:29.320029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d4335-bf86-4d27-bd52-8b1a1b44d5ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-754d4335-bf86-4d27-bd52-8b1a1b44d5ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:29.330912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:29.332028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:29.332861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:29.335349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 150/312] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:29.341393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d4335-bf86-4d27-bd52-8b1a1b44d5ef None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:29.372298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:29.380510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce5055-61e7-4bd5-91e0-79f6cf8ee1a3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:29.417761 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8df87-bab0-46d2-9375-06b0ead38302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:29.418949 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8df87-bab0-46d2-9375-06b0ead38302 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:29.419386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8df87-bab0-46d2-9375-06b0ead38302 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:29.419805 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8df87-bab0-46d2-9375-06b0ead38302 None admin] PATH_INFO: `/v3/system/users/b0dbcc9b77d54e249a6563cbd16110b7/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:29.421577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8df87-bab0-46d2-9375-06b0ead38302 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b0dbcc9b77d54e249a6563cbd16110b7, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:29.423210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8df87-bab0-46d2-9375-06b0ead38302 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:29.433922 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 163/313] 10.222.0.66 () {58 vars in 1334 bytes} [Mon Jul 11 13:59:29 2022] PUT /identity/v3/system/users/b0dbcc9b77d54e249a6563cbd16110b7/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:29.458857 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d4335-bf86-4d27-bd52-8b1a1b44d5ef None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:29.500550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4357e-7f37-4c0f-8854-9024b8185782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:29.501187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4357e-7f37-4c0f-8854-9024b8185782 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:29.501457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4357e-7f37-4c0f-8854-9024b8185782 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:29.501739 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4357e-7f37-4c0f-8854-9024b8185782 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:29.502550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4357e-7f37-4c0f-8854-9024b8185782 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:29.502859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4357e-7f37-4c0f-8854-9024b8185782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:29.504288 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4357e-7f37-4c0f-8854-9024b8185782 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:29.514703 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 151/314] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:29.520657 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8df87-bab0-46d2-9375-06b0ead38302 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:29.601826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:29.639398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8df87-bab0-46d2-9375-06b0ead38302 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:29.684608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e053957-cf8a-4de8-b6b7-4666c39342b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:29.685492 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e053957-cf8a-4de8-b6b7-4666c39342b9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:29.685773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e053957-cf8a-4de8-b6b7-4666c39342b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:29.686048 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e053957-cf8a-4de8-b6b7-4666c39342b9 None admin] PATH_INFO: `/v3/users/5b2d785261bc4b53a4e069cdab9be974` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:29.687289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e053957-cf8a-4de8-b6b7-4666c39342b9 None admin] RBAC: Authorizing `identity:get_user(user_id=5b2d785261bc4b53a4e069cdab9be974)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:29.688742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e053957-cf8a-4de8-b6b7-4666c39342b9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:29.690722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 164/315] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:29 2022] GET /identity/v3/users/5b2d785261bc4b53a4e069cdab9be974 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:29.696124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4357e-7f37-4c0f-8854-9024b8185782 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:29.794611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:29.809787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4357e-7f37-4c0f-8854-9024b8185782 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:29.845608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d909ae1-57ec-4c7e-9b0e-d7ad3782819d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:29.846663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d909ae1-57ec-4c7e-9b0e-d7ad3782819d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:29.847179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d909ae1-57ec-4c7e-9b0e-d7ad3782819d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:29.847653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d909ae1-57ec-4c7e-9b0e-d7ad3782819d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:29.921712 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d909ae1-57ec-4c7e-9b0e-d7ad3782819d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:29.923992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d909ae1-57ec-4c7e-9b0e-d7ad3782819d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:30.022722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:30.041141 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 152/316] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:30.042995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e053957-cf8a-4de8-b6b7-4666c39342b9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:30.155109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e053957-cf8a-4de8-b6b7-4666c39342b9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:30.194306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc0559-8ced-4aaf-a408-ce7e3cbf1931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:30.195185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc0559-8ced-4aaf-a408-ce7e3cbf1931 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:30.195475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc0559-8ced-4aaf-a408-ce7e3cbf1931 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:30.195766 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc0559-8ced-4aaf-a408-ce7e3cbf1931 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:30.197001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc0559-8ced-4aaf-a408-ce7e3cbf1931 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:30.198494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc0559-8ced-4aaf-a408-ce7e3cbf1931 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:30.200548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 165/317] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:30 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:30.206502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d909ae1-57ec-4c7e-9b0e-d7ad3782819d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:30.311337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d909ae1-57ec-4c7e-9b0e-d7ad3782819d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:30.349132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c93f2-48cd-4adb-80f8-bbfd1912af6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:30.349813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c93f2-48cd-4adb-80f8-bbfd1912af6e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:30.350096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c93f2-48cd-4adb-80f8-bbfd1912af6e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:30.350393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c93f2-48cd-4adb-80f8-bbfd1912af6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:30.351249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c93f2-48cd-4adb-80f8-bbfd1912af6e None admin] RBAC: Adding query filter params (role.id=07eba1cca2a34e7bbde6d6a82772b4ae, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac, user.id=5b2d785261bc4b53a4e069cdab9be974) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:30.351559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c93f2-48cd-4adb-80f8-bbfd1912af6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:30.353832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c93f2-48cd-4adb-80f8-bbfd1912af6e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:30.364064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 153/318] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:30 2022] GET /identity/v3/role_assignments?user.id=5b2d785261bc4b53a4e069cdab9be974&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=07eba1cca2a34e7bbde6d6a82772b4ae => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:31.121383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93f08-d2a9-4573-8dc9-74ca6573a722 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.121912 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93f08-d2a9-4573-8dc9-74ca6573a722 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.121912 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c93f08-d2a9-4573-8dc9-74ca6573a722 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.123534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 166/319] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:31.128770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4037a5-e0c9-4f8f-a266-730e230e1408 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.129189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4037a5-e0c9-4f8f-a266-730e230e1408 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.129375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4037a5-e0c9-4f8f-a266-730e230e1408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.147378 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5d4037a5-e0c9-4f8f-a266-730e230e1408 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:31.149105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5d4037a5-e0c9-4f8f-a266-730e230e1408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:31.164597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397215a-40d7-4794-ad02-481f84e08287 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.164897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397215a-40d7-4794-ad02-481f84e08287 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.165892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397215a-40d7-4794-ad02-481f84e08287 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.167498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 167/320] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:31.173711 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6cf9-8690-46d1-98fb-3ac94a06e459 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.174009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6cf9-8690-46d1-98fb-3ac94a06e459 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.174328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6cf9-8690-46d1-98fb-3ac94a06e459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.190904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-63bd6cf9-8690-46d1-98fb-3ac94a06e459 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:31.192194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-63bd6cf9-8690-46d1-98fb-3ac94a06e459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:31.194330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:31.207825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:31.236471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 154/321] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:31.258675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4037a5-e0c9-4f8f-a266-730e230e1408 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:31.277405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 168/322] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:31.299301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd6cf9-8690-46d1-98fb-3ac94a06e459 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:31.373586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4037a5-e0c9-4f8f-a266-730e230e1408 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:31.400364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd6cf9-8690-46d1-98fb-3ac94a06e459 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:31.410817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a757622-33f1-45db-ae1a-52765477bde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:31.411726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a757622-33f1-45db-ae1a-52765477bde4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.412030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a757622-33f1-45db-ae1a-52765477bde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.412286 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a757622-33f1-45db-ae1a-52765477bde4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.423572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a757622-33f1-45db-ae1a-52765477bde4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7a757622-33f1-45db-ae1a-52765477bde4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:31.431984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:31.432879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:31.434439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 155/323] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:31.436308 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d33b3-b96f-4c10-bf96-ea2ef42150ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:31.437113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d33b3-b96f-4c10-bf96-ea2ef42150ab None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.437408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d33b3-b96f-4c10-bf96-ea2ef42150ab None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.437705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d33b3-b96f-4c10-bf96-ea2ef42150ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.438998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a757622-33f1-45db-ae1a-52765477bde4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:31.439300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d33b3-b96f-4c10-bf96-ea2ef42150ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:31.440750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d33b3-b96f-4c10-bf96-ea2ef42150ab None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:31.442620 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 169/324] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:31.448147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d33b3-b96f-4c10-bf96-ea2ef42150ab None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:31.456686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:31.492081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:31.554786 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a757622-33f1-45db-ae1a-52765477bde4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:31.555240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d33b3-b96f-4c10-bf96-ea2ef42150ab None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:31.589361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c28892-76fb-4ac2-be73-c319835d8df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:31.590040 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c28892-76fb-4ac2-be73-c319835d8df9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.590366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c28892-76fb-4ac2-be73-c319835d8df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.590647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c28892-76fb-4ac2-be73-c319835d8df9 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.591409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c28892-76fb-4ac2-be73-c319835d8df9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:31.591720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c28892-76fb-4ac2-be73-c319835d8df9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:31.593077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2552d28-aeb5-4f2c-983e-063ac85f4f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:31.593203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c28892-76fb-4ac2-be73-c319835d8df9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:31.593999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552d28-aeb5-4f2c-983e-063ac85f4f82 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.594449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552d28-aeb5-4f2c-983e-063ac85f4f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.594869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552d28-aeb5-4f2c-983e-063ac85f4f82 None admin] PATH_INFO: `/v3/groups` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.595697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2552d28-aeb5-4f2c-983e-063ac85f4f82 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:31.597253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2552d28-aeb5-4f2c-983e-063ac85f4f82 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:31.602280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 156/325] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:31.607804 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c28892-76fb-4ac2-be73-c319835d8df9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:31.618013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 170/326] 10.222.0.66 () {60 vars in 1134 bytes} [Mon Jul 11 13:59:31 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 13:59:31.621525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c0a9-28f2-40e0-bfc8-35fed461a23a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.622241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c0a9-28f2-40e0-bfc8-35fed461a23a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.622541 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c0a9-28f2-40e0-bfc8-35fed461a23a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.624736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 171/327] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:31.630548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163bc09-96e5-4e4e-a6c7-c1701ab59248 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.630858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163bc09-96e5-4e4e-a6c7-c1701ab59248 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.631176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163bc09-96e5-4e4e-a6c7-c1701ab59248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.654459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1163bc09-96e5-4e4e-a6c7-c1701ab59248 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:31.655705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1163bc09-96e5-4e4e-a6c7-c1701ab59248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:31.733295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c28892-76fb-4ac2-be73-c319835d8df9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:31.735856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:31.736003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:31.746476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 172/328] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:31.769264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163bc09-96e5-4e4e-a6c7-c1701ab59248 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:31.777977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c31be-b76f-4b2a-9e53-20be5ab704c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:31.778410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c31be-b76f-4b2a-9e53-20be5ab704c2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.779535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c31be-b76f-4b2a-9e53-20be5ab704c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.779535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c31be-b76f-4b2a-9e53-20be5ab704c2 None admin] PATH_INFO: `/v3/users/29b40bcb3a264b9498e17328df17f6da` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.780168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c31be-b76f-4b2a-9e53-20be5ab704c2 None admin] RBAC: Authorizing `identity:get_user(user_id=29b40bcb3a264b9498e17328df17f6da)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:31.781627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c31be-b76f-4b2a-9e53-20be5ab704c2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:31.783446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 157/329] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:31 2022] GET /identity/v3/users/29b40bcb3a264b9498e17328df17f6da => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:31.790042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c31be-b76f-4b2a-9e53-20be5ab704c2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:31.887704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163bc09-96e5-4e4e-a6c7-c1701ab59248 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:31.911777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c31be-b76f-4b2a-9e53-20be5ab704c2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:31.930343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15254337-14f6-4f15-ac38-3d41a27c3eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:31.931218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15254337-14f6-4f15-ac38-3d41a27c3eac None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.931507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15254337-14f6-4f15-ac38-3d41a27c3eac None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.931776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15254337-14f6-4f15-ac38-3d41a27c3eac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.943946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15254337-14f6-4f15-ac38-3d41a27c3eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-15254337-14f6-4f15-ac38-3d41a27c3eac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:31.952394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:31.953288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:31.954076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:31.956534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 173/330] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:31.963516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7edc79-9593-49a8-9c1d-bf07fa680441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:31.963709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15254337-14f6-4f15-ac38-3d41a27c3eac None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:31.963798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7edc79-9593-49a8-9c1d-bf07fa680441 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:31.963798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7edc79-9593-49a8-9c1d-bf07fa680441 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:31.963798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7edc79-9593-49a8-9c1d-bf07fa680441 None admin] PATH_INFO: `/v3/system/users/29b40bcb3a264b9498e17328df17f6da/roles/07eba1cca2a34e7bbde6d6a82772b4ae` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:31.965324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7edc79-9593-49a8-9c1d-bf07fa680441 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=29b40bcb3a264b9498e17328df17f6da, role_id=07eba1cca2a34e7bbde6d6a82772b4ae)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:31.966959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7edc79-9593-49a8-9c1d-bf07fa680441 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:31.978745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 158/331] 10.222.0.66 () {58 vars in 1334 bytes} [Mon Jul 11 13:59:31 2022] PUT /identity/v3/system/users/29b40bcb3a264b9498e17328df17f6da/roles/07eba1cca2a34e7bbde6d6a82772b4ae => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:32.042725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:32.101463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15254337-14f6-4f15-ac38-3d41a27c3eac None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:32.144291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f674a65-e003-499e-9f02-83bfbb8f6bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:32.145950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674a65-e003-499e-9f02-83bfbb8f6bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:32.146509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674a65-e003-499e-9f02-83bfbb8f6bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:32.146973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674a65-e003-499e-9f02-83bfbb8f6bf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:32.148039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f674a65-e003-499e-9f02-83bfbb8f6bf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:32.148532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f674a65-e003-499e-9f02-83bfbb8f6bf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:32.151064 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f674a65-e003-499e-9f02-83bfbb8f6bf9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:32.164254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 174/332] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:32.170816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7edc79-9593-49a8-9c1d-bf07fa680441 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:32.238519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:32.296855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7edc79-9593-49a8-9c1d-bf07fa680441 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:32.339790 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d350a90-7f88-4b2e-a10f-f84c8ac6dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:32.340688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d350a90-7f88-4b2e-a10f-f84c8ac6dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:32.340971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d350a90-7f88-4b2e-a10f-f84c8ac6dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:32.341251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d350a90-7f88-4b2e-a10f-f84c8ac6dd3d None admin] PATH_INFO: `/v3/users/b0dbcc9b77d54e249a6563cbd16110b7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:32.342517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d350a90-7f88-4b2e-a10f-f84c8ac6dd3d None admin] RBAC: Authorizing `identity:get_user(user_id=b0dbcc9b77d54e249a6563cbd16110b7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:32.343986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d350a90-7f88-4b2e-a10f-f84c8ac6dd3d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:32.345964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 159/333] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:32 2022] GET /identity/v3/users/b0dbcc9b77d54e249a6563cbd16110b7 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:32.351264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f674a65-e003-499e-9f02-83bfbb8f6bf9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:32.500402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f674a65-e003-499e-9f02-83bfbb8f6bf9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:32.522195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:32.544868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f19fd5-398d-4ab2-b32f-35875df519da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:32.545555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f19fd5-398d-4ab2-b32f-35875df519da None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:32.545845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f19fd5-398d-4ab2-b32f-35875df519da None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:32.546128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f19fd5-398d-4ab2-b32f-35875df519da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:32.547030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f19fd5-398d-4ab2-b32f-35875df519da None admin] RBAC: Adding query filter params (role.id=8b1dade745704cf3a2a92b5ac07853b4, user.id=b0dbcc9b77d54e249a6563cbd16110b7, scope.system=all) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:32.547349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f19fd5-398d-4ab2-b32f-35875df519da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:32.548809 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f19fd5-398d-4ab2-b32f-35875df519da None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:32.564768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 175/334] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Jul 11 13:59:32 2022] GET /identity/v3/role_assignments?user.id=b0dbcc9b77d54e249a6563cbd16110b7&scope.system=all&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:34.099536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dde60-ab16-4d48-ab2c-f457386d1b3b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:34.100106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dde60-ab16-4d48-ab2c-f457386d1b3b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:34.100106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dde60-ab16-4d48-ab2c-f457386d1b3b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:34.101451 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 160/335] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:34.107235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda0b61-4312-4e66-95ef-4e54e972367a None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:34.107689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda0b61-4312-4e66-95ef-4e54e972367a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:34.107837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda0b61-4312-4e66-95ef-4e54e972367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:34.131206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2eda0b61-4312-4e66-95ef-4e54e972367a None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:34.132572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2eda0b61-4312-4e66-95ef-4e54e972367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:34.225554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 176/336] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:34.261840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dde60-ab16-4d48-ab2c-f457386d1b3b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:34.396847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dde60-ab16-4d48-ab2c-f457386d1b3b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:34.399558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:34.444341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5b65-e727-4aa2-a7d8-9481dadae19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:34.445151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5b65-e727-4aa2-a7d8-9481dadae19c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:34.445432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5b65-e727-4aa2-a7d8-9481dadae19c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:34.445710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5b65-e727-4aa2-a7d8-9481dadae19c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:34.464090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b5b65-e727-4aa2-a7d8-9481dadae19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-778b5b65-e727-4aa2-a7d8-9481dadae19c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:34.474761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:34.475740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:34.476983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 161/337] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:34.483146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda0b61-4312-4e66-95ef-4e54e972367a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:34.621582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda0b61-4312-4e66-95ef-4e54e972367a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:34.632766 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:34.678066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e11993-5dd7-4686-9fb8-8abc16a3d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:34.678789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e11993-5dd7-4686-9fb8-8abc16a3d033 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:34.679075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e11993-5dd7-4686-9fb8-8abc16a3d033 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:34.679351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e11993-5dd7-4686-9fb8-8abc16a3d033 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:34.680116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e11993-5dd7-4686-9fb8-8abc16a3d033 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:34.680421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e11993-5dd7-4686-9fb8-8abc16a3d033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:34.682233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e11993-5dd7-4686-9fb8-8abc16a3d033 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:34.694674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 177/338] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:34.702261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5b65-e727-4aa2-a7d8-9481dadae19c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:34.839997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5b65-e727-4aa2-a7d8-9481dadae19c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:34.846488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bb6ea-f67a-49f9-b814-94c200f971fe None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:34.846790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bb6ea-f67a-49f9-b814-94c200f971fe None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:34.847072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bb6ea-f67a-49f9-b814-94c200f971fe None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:34.848744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 178/339] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:34.868112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298b2d-c3ba-46ab-83d5-ffdf0c4555e6 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:34.868580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298b2d-c3ba-46ab-83d5-ffdf0c4555e6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:34.868935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3298b2d-c3ba-46ab-83d5-ffdf0c4555e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:34.901235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615c5dd-b03c-492c-b177-2a61652f537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:34.901926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615c5dd-b03c-492c-b177-2a61652f537c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:34.902218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615c5dd-b03c-492c-b177-2a61652f537c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:34.902495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615c5dd-b03c-492c-b177-2a61652f537c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:34.903223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b3298b2d-c3ba-46ab-83d5-ffdf0c4555e6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:34.904455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b3298b2d-c3ba-46ab-83d5-ffdf0c4555e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:34.982879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:35.055664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 179/340] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:35.079469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615c5dd-b03c-492c-b177-2a61652f537c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:35.081012 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615c5dd-b03c-492c-b177-2a61652f537c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:35.098903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3298b2d-c3ba-46ab-83d5-ffdf0c4555e6 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:35.317804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:35.331359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3298b2d-c3ba-46ab-83d5-ffdf0c4555e6 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:35.340584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 162/341] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:35.342596 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c692-0b23-4c8c-be9c-c5c25aa1d21d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:35.343032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c692-0b23-4c8c-be9c-c5c25aa1d21d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:35.343579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354c692-0b23-4c8c-be9c-c5c25aa1d21d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:35.349577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 163/342] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:35.351220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299057bb-aa2d-4105-b480-595603d18f4e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:35.351711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299057bb-aa2d-4105-b480-595603d18f4e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:35.352185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299057bb-aa2d-4105-b480-595603d18f4e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:35.354001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 164/343] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:35.354974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299057bb-aa2d-4105-b480-595603d18f4e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:35.394622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0b58d-d750-44b7-a3b5-c36255299d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:35.395694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b58d-d750-44b7-a3b5-c36255299d5f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:35.396011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b58d-d750-44b7-a3b5-c36255299d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:35.396251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0b58d-d750-44b7-a3b5-c36255299d5f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:35.408241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d0b58d-d750-44b7-a3b5-c36255299d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-78d0b58d-d750-44b7-a3b5-c36255299d5f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:35.416704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:35.417652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:35.418473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 180/344] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:35.419853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689b70-9325-4da0-9e4b-1a6e1cd97e43 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:35.419853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689b70-9325-4da0-9e4b-1a6e1cd97e43 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:35.425635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e689b70-9325-4da0-9e4b-1a6e1cd97e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:35.447174 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0e689b70-9325-4da0-9e4b-1a6e1cd97e43 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:35.448585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0e689b70-9325-4da0-9e4b-1a6e1cd97e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:35.449496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:35.496497 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299057bb-aa2d-4105-b480-595603d18f4e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:35.538340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 181/345] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:35.540375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b50567-0260-4c7c-91d3-130d4abdc35d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:35.540771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b50567-0260-4c7c-91d3-130d4abdc35d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:35.541141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b50567-0260-4c7c-91d3-130d4abdc35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:35.548818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea514c7-1569-429c-8f7f-082962eaa37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:35.550573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea514c7-1569-429c-8f7f-082962eaa37c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:35.551239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea514c7-1569-429c-8f7f-082962eaa37c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:35.552002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea514c7-1569-429c-8f7f-082962eaa37c None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:35.554131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea514c7-1569-429c-8f7f-082962eaa37c None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:35.557002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea514c7-1569-429c-8f7f-082962eaa37c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:35.559119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 165/346] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:35 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:35.560262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea514c7-1569-429c-8f7f-082962eaa37c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:35.577478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d2b50567-0260-4c7c-91d3-130d4abdc35d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:35.579735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d2b50567-0260-4c7c-91d3-130d4abdc35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:35.683054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 182/347] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:35.684260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b50567-0260-4c7c-91d3-130d4abdc35d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:35.717790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:35.735278 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea514c7-1569-429c-8f7f-082962eaa37c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:35.777836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:35.786796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1e7a5-1bbc-4105-800f-a47df9cad018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:35.787744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1e7a5-1bbc-4105-800f-a47df9cad018 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:35.788209 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1e7a5-1bbc-4105-800f-a47df9cad018 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:35.788698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1e7a5-1bbc-4105-800f-a47df9cad018 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:35.789675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1e7a5-1bbc-4105-800f-a47df9cad018 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:35.790298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1e7a5-1bbc-4105-800f-a47df9cad018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:35.791893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1e7a5-1bbc-4105-800f-a47df9cad018 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:35.806388 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 166/348] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:35.807697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1e7a5-1bbc-4105-800f-a47df9cad018 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:35.828155 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b50567-0260-4c7c-91d3-130d4abdc35d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:35.865825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da165f-b09e-4974-b5ae-b02747f20be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:35.866953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da165f-b09e-4974-b5ae-b02747f20be1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:35.867066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da165f-b09e-4974-b5ae-b02747f20be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:35.867342 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da165f-b09e-4974-b5ae-b02747f20be1 None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:35.874372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da165f-b09e-4974-b5ae-b02747f20be1 None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:35.875734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da165f-b09e-4974-b5ae-b02747f20be1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:35.877520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 183/349] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:35 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:35.879480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da165f-b09e-4974-b5ae-b02747f20be1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:35.924663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1e7a5-1bbc-4105-800f-a47df9cad018 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:35.961485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e0721-d40b-47ac-9a12-e21d99edf3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:35.963269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e0721-d40b-47ac-9a12-e21d99edf3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:35.963874 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e0721-d40b-47ac-9a12-e21d99edf3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:35.964365 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e0721-d40b-47ac-9a12-e21d99edf3a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:35.971843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:35.977193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e0721-d40b-47ac-9a12-e21d99edf3a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-882e0721-d40b-47ac-9a12-e21d99edf3a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:35.985903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:35.986928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:35.987744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:35.990266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 167/350] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:35.992815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da165f-b09e-4974-b5ae-b02747f20be1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:35.993121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e0721-d40b-47ac-9a12-e21d99edf3a8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:36.048874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751b25c-632e-4ba4-9977-d61787ad0442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:36.049700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751b25c-632e-4ba4-9977-d61787ad0442 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:36.049996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751b25c-632e-4ba4-9977-d61787ad0442 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:36.050298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751b25c-632e-4ba4-9977-d61787ad0442 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:36.072228 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751b25c-632e-4ba4-9977-d61787ad0442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-9751b25c-632e-4ba4-9977-d61787ad0442 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:36.080261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:36.081210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:36.082022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 184/351] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:36.082745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751b25c-632e-4ba4-9977-d61787ad0442 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:36.100560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:36.160541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e0721-d40b-47ac-9a12-e21d99edf3a8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:36.201720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d65a68-d234-4800-b41a-285a5449abac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:36.202664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65a68-d234-4800-b41a-285a5449abac None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:36.202947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65a68-d234-4800-b41a-285a5449abac None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:36.203223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d65a68-d234-4800-b41a-285a5449abac None admin] PATH_INFO: `/v3/users/29b40bcb3a264b9498e17328df17f6da` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:36.204480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d65a68-d234-4800-b41a-285a5449abac None admin] RBAC: Authorizing `identity:get_user(user_id=29b40bcb3a264b9498e17328df17f6da)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:36.205942 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d65a68-d234-4800-b41a-285a5449abac None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:36.212786 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 168/352] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 13:59:35 2022] GET /identity/v3/users/29b40bcb3a264b9498e17328df17f6da => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:36.213742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d65a68-d234-4800-b41a-285a5449abac None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:36.221932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751b25c-632e-4ba4-9977-d61787ad0442 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:36.261826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41ac90-08b2-4ede-b4b1-a8d576570974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:36.262655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41ac90-08b2-4ede-b4b1-a8d576570974 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:36.263194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41ac90-08b2-4ede-b4b1-a8d576570974 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:36.263296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41ac90-08b2-4ede-b4b1-a8d576570974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:36.264211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41ac90-08b2-4ede-b4b1-a8d576570974 None admin] RBAC: Adding query filter params (group.id=27a1e7c050ff43b9bcfd1e35fbc6650c, role.id=8b1dade745704cf3a2a92b5ac07853b4, scope.project.id=d94efb6a61fb468abaff458dda955336) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:36.264660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41ac90-08b2-4ede-b4b1-a8d576570974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:36.266717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41ac90-08b2-4ede-b4b1-a8d576570974 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:36.276540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 185/353] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 11 13:59:36 2022] GET /identity/v3/role_assignments?group.id=27a1e7c050ff43b9bcfd1e35fbc6650c&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:36.277244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41ac90-08b2-4ede-b4b1-a8d576570974 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:36.290675 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:36.333990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d65a68-d234-4800-b41a-285a5449abac None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:36.370543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:36.388174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bff4c-3bc5-4936-bbb5-38d5e801e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:36.389064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bff4c-3bc5-4936-bbb5-38d5e801e981 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:36.389836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bff4c-3bc5-4936-bbb5-38d5e801e981 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:36.390124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bff4c-3bc5-4936-bbb5-38d5e801e981 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:36.391239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bff4c-3bc5-4936-bbb5-38d5e801e981 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:36.391553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bff4c-3bc5-4936-bbb5-38d5e801e981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:36.393172 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bff4c-3bc5-4936-bbb5-38d5e801e981 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:36.404109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 169/354] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:36.404997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bff4c-3bc5-4936-bbb5-38d5e801e981 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:36.428221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41ac90-08b2-4ede-b4b1-a8d576570974 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:36.476614 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e802ace-d1bb-415b-a4d4-427d3ffd8849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:36.476861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e802ace-d1bb-415b-a4d4-427d3ffd8849 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:36.477131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e802ace-d1bb-415b-a4d4-427d3ffd8849 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:36.477520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e802ace-d1bb-415b-a4d4-427d3ffd8849 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:36.479069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e802ace-d1bb-415b-a4d4-427d3ffd8849 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:36.479240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e802ace-d1bb-415b-a4d4-427d3ffd8849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:36.480687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e802ace-d1bb-415b-a4d4-427d3ffd8849 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:36.490920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 186/355] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:36.492270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee345f18-75ea-4473-801a-8e0bf933143f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:36.492576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee345f18-75ea-4473-801a-8e0bf933143f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:36.492853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee345f18-75ea-4473-801a-8e0bf933143f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:36.495011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 187/356] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:36.500147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee345f18-75ea-4473-801a-8e0bf933143f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:36.565678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bff4c-3bc5-4936-bbb5-38d5e801e981 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:36.598385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:36.623550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b09b2b-2c09-4a4f-a8a4-3dc4ed216393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:36.624820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b09b2b-2c09-4a4f-a8a4-3dc4ed216393 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:36.625303 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b09b2b-2c09-4a4f-a8a4-3dc4ed216393 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:36.625960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b09b2b-2c09-4a4f-a8a4-3dc4ed216393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:36.627357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b09b2b-2c09-4a4f-a8a4-3dc4ed216393 None admin] RBAC: Adding query filter params (role.id=07eba1cca2a34e7bbde6d6a82772b4ae, user.id=29b40bcb3a264b9498e17328df17f6da, scope.system=all) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:36.627887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b09b2b-2c09-4a4f-a8a4-3dc4ed216393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:36.629381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b09b2b-2c09-4a4f-a8a4-3dc4ed216393 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:36.650117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 170/357] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Jul 11 13:59:36 2022] GET /identity/v3/role_assignments?user.id=29b40bcb3a264b9498e17328df17f6da&scope.system=all&role.id=07eba1cca2a34e7bbde6d6a82772b4ae => generated 510 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:36.650117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ee32-7567-4514-a6ca-27b506d2c791 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:36.650117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ee32-7567-4514-a6ca-27b506d2c791 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:36.650503 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee345f18-75ea-4473-801a-8e0bf933143f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:36.650584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710ee32-7567-4514-a6ca-27b506d2c791 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:36.650584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 171/358] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:36.650978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710ee32-7567-4514-a6ca-27b506d2c791 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:36.698063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3eaa91-28d7-4398-aab2-e0d16a64f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:36.698774 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3eaa91-28d7-4398-aab2-e0d16a64f525 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:36.699062 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3eaa91-28d7-4398-aab2-e0d16a64f525 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:36.699464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3eaa91-28d7-4398-aab2-e0d16a64f525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:36.711863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:36.788639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710ee32-7567-4514-a6ca-27b506d2c791 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:36.796169 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3eaa91-28d7-4398-aab2-e0d16a64f525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:36.797690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3eaa91-28d7-4398-aab2-e0d16a64f525 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:36.833166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0cc41-a09b-4909-8825-1c3b390875d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:36.833840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0cc41-a09b-4909-8825-1c3b390875d9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:36.834128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0cc41-a09b-4909-8825-1c3b390875d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:36.834440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0cc41-a09b-4909-8825-1c3b390875d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:36.903772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:36.922264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0cc41-a09b-4909-8825-1c3b390875d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:36.923738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0cc41-a09b-4909-8825-1c3b390875d9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:36.954219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 188/359] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:36.956255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979045f4-7324-422c-9de8-61d596e0a9da None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:36.956587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979045f4-7324-422c-9de8-61d596e0a9da None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:36.956818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979045f4-7324-422c-9de8-61d596e0a9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:36.984451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-979045f4-7324-422c-9de8-61d596e0a9da None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:36.985244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:36.987185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-979045f4-7324-422c-9de8-61d596e0a9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:37.053856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 172/360] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:37.055711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172abf30-f8f0-44d3-8f00-dc9861dbed7c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:37.055950 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172abf30-f8f0-44d3-8f00-dc9861dbed7c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:37.056228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172abf30-f8f0-44d3-8f00-dc9861dbed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:37.067672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 189/361] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:37.075001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-172abf30-f8f0-44d3-8f00-dc9861dbed7c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:37.075154 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979045f4-7324-422c-9de8-61d596e0a9da None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:37.076207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-172abf30-f8f0-44d3-8f00-dc9861dbed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:37.168151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 173/362] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:37.169344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172abf30-f8f0-44d3-8f00-dc9861dbed7c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:37.227470 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:37.231834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979045f4-7324-422c-9de8-61d596e0a9da None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:37.259936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:37.285768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2c023-fae6-4a92-a39c-7ce8cf8ca54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:37.286740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c023-fae6-4a92-a39c-7ce8cf8ca54f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:37.287027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c023-fae6-4a92-a39c-7ce8cf8ca54f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:37.287305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c023-fae6-4a92-a39c-7ce8cf8ca54f None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:37.289594 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2c023-fae6-4a92-a39c-7ce8cf8ca54f None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:37.291654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2c023-fae6-4a92-a39c-7ce8cf8ca54f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:37.294945 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 190/363] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:37 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:37.295254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2c023-fae6-4a92-a39c-7ce8cf8ca54f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:37.299457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172abf30-f8f0-44d3-8f00-dc9861dbed7c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:37.339081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a41d8-52a1-4f55-8d79-3e32e228b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:37.340229 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a41d8-52a1-4f55-8d79-3e32e228b318 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:37.340698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a41d8-52a1-4f55-8d79-3e32e228b318 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:37.340965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a41d8-52a1-4f55-8d79-3e32e228b318 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:37.342883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a41d8-52a1-4f55-8d79-3e32e228b318 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:37.343661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a41d8-52a1-4f55-8d79-3e32e228b318 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:37.345413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 174/364] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:37 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:37.347013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a41d8-52a1-4f55-8d79-3e32e228b318 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:37.437733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2c023-fae6-4a92-a39c-7ce8cf8ca54f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:37.468525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a41d8-52a1-4f55-8d79-3e32e228b318 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:37.487784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0965da-31a8-4052-8c7a-f2206b8fa854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:37.489497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0965da-31a8-4052-8c7a-f2206b8fa854 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:37.489944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0965da-31a8-4052-8c7a-f2206b8fa854 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:37.490397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0965da-31a8-4052-8c7a-f2206b8fa854 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:37.506460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0965da-31a8-4052-8c7a-f2206b8fa854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:37.513013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98967106-7ad2-4126-b24c-fb680e2c8521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:37.513910 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98967106-7ad2-4126-b24c-fb680e2c8521 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:37.514297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98967106-7ad2-4126-b24c-fb680e2c8521 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:37.514653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98967106-7ad2-4126-b24c-fb680e2c8521 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8e0965da-31a8-4052-8c7a-f2206b8fa854 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:37.518243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:37.519396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:37.520702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:37.523202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 191/365] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:37.524942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0965da-31a8-4052-8c7a-f2206b8fa854 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:37.528871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98967106-7ad2-4126-b24c-fb680e2c8521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:37.534305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-98967106-7ad2-4126-b24c-fb680e2c8521 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:37.537688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:37.538853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:37.539828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:37.544457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 175/366] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:59:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:37.546761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98967106-7ad2-4126-b24c-fb680e2c8521 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:37.568179 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:37.664103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0965da-31a8-4052-8c7a-f2206b8fa854 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:37.692190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98967106-7ad2-4126-b24c-fb680e2c8521 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:37.717906 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d75b72-364c-4b39-8dfb-44c473ed0946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:37.719649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d75b72-364c-4b39-8dfb-44c473ed0946 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:37.719649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d75b72-364c-4b39-8dfb-44c473ed0946 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:37.719856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d75b72-364c-4b39-8dfb-44c473ed0946 None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:37.721025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d75b72-364c-4b39-8dfb-44c473ed0946 None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:37.722603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d75b72-364c-4b39-8dfb-44c473ed0946 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:37.724815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 192/367] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:37 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:37.725400 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d75b72-364c-4b39-8dfb-44c473ed0946 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:37.745901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8fef-a21c-4e1e-a107-883e674eb03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:37.746835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8fef-a21c-4e1e-a107-883e674eb03d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:37.747130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8fef-a21c-4e1e-a107-883e674eb03d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:37.747412 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8fef-a21c-4e1e-a107-883e674eb03d None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:37.748686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d8fef-a21c-4e1e-a107-883e674eb03d None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:37.750208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d8fef-a21c-4e1e-a107-883e674eb03d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:37.751859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 176/368] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:37 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:37.752620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8fef-a21c-4e1e-a107-883e674eb03d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:37.836422 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:37.856325 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:37.865929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d75b72-364c-4b39-8dfb-44c473ed0946 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:37.896417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8fef-a21c-4e1e-a107-883e674eb03d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:37.927811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8924-41cf-4401-bd9c-4915ce798888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:37.928504 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8924-41cf-4401-bd9c-4915ce798888 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:37.928794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8924-41cf-4401-bd9c-4915ce798888 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:37.929076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c8924-41cf-4401-bd9c-4915ce798888 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:37.929847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c8924-41cf-4401-bd9c-4915ce798888 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:37.930192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c8924-41cf-4401-bd9c-4915ce798888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:37.932269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c8924-41cf-4401-bd9c-4915ce798888 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:37.944928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 193/369] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:37.944928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8924-41cf-4401-bd9c-4915ce798888 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:37.955544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dd739-3fb6-4013-a6e8-79595f23edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:37.956874 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dd739-3fb6-4013-a6e8-79595f23edba None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:37.957162 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dd739-3fb6-4013-a6e8-79595f23edba None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:37.957894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dd739-3fb6-4013-a6e8-79595f23edba None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:37.958343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dd739-3fb6-4013-a6e8-79595f23edba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:37.959041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dd739-3fb6-4013-a6e8-79595f23edba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:37.960821 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737dd739-3fb6-4013-a6e8-79595f23edba None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:37.978717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 177/370] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:37.979710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dd739-3fb6-4013-a6e8-79595f23edba None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:38.094317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c8924-41cf-4401-bd9c-4915ce798888 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:38.113083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dd739-3fb6-4013-a6e8-79595f23edba None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:38.141848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6ab13-5eac-4cb4-a3af-5d1ef94ad9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:38.142631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ab13-5eac-4cb4-a3af-5d1ef94ad9db None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:38.142915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ab13-5eac-4cb4-a3af-5d1ef94ad9db None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:38.143734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6ab13-5eac-4cb4-a3af-5d1ef94ad9db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:38.144087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6ab13-5eac-4cb4-a3af-5d1ef94ad9db None admin] RBAC: Adding query filter params (group.id=27a1e7c050ff43b9bcfd1e35fbc6650c, role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7, scope.project.id=d94efb6a61fb468abaff458dda955336) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:38.144405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6ab13-5eac-4cb4-a3af-5d1ef94ad9db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:38.146127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6ab13-5eac-4cb4-a3af-5d1ef94ad9db None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:38.156199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:38.162430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 194/371] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 11 13:59:37 2022] GET /identity/v3/role_assignments?group.id=27a1e7c050ff43b9bcfd1e35fbc6650c&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:38.163474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6ab13-5eac-4cb4-a3af-5d1ef94ad9db None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:38.168411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d199f-260b-47a2-8639-d1d1dbc9105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:38.169102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d199f-260b-47a2-8639-d1d1dbc9105d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:38.169397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d199f-260b-47a2-8639-d1d1dbc9105d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:38.169673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d199f-260b-47a2-8639-d1d1dbc9105d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:38.174144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d199f-260b-47a2-8639-d1d1dbc9105d None admin] RBAC: Adding query filter params (group.id=27a1e7c050ff43b9bcfd1e35fbc6650c, role.id=8b1dade745704cf3a2a92b5ac07853b4, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:38.174144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d199f-260b-47a2-8639-d1d1dbc9105d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:38.174144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d199f-260b-47a2-8639-d1d1dbc9105d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:38.182778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 178/372] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 11 13:59:37 2022] GET /identity/v3/role_assignments?group.id=27a1e7c050ff43b9bcfd1e35fbc6650c&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:38.182778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d199f-260b-47a2-8639-d1d1dbc9105d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:38.203689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:38.386599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6ab13-5eac-4cb4-a3af-5d1ef94ad9db None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:38.405186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d199f-260b-47a2-8639-d1d1dbc9105d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:38.430074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ea54a-256c-4ad6-998f-fda93c7a4c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:38.430868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ea54a-256c-4ad6-998f-fda93c7a4c08 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:38.431160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ea54a-256c-4ad6-998f-fda93c7a4c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:38.431446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ea54a-256c-4ad6-998f-fda93c7a4c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:38.449015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f9cd2-3a68-471c-af12-af68e60b0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:38.449951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f9cd2-3a68-471c-af12-af68e60b0719 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:38.450268 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f9cd2-3a68-471c-af12-af68e60b0719 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:38.450551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f9cd2-3a68-471c-af12-af68e60b0719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:38.511957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ea54a-256c-4ad6-998f-fda93c7a4c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:38.513630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ea54a-256c-4ad6-998f-fda93c7a4c08 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:38.529900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:38.539227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f9cd2-3a68-471c-af12-af68e60b0719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:38.541039 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f9cd2-3a68-471c-af12-af68e60b0719 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:38.558552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:38.642832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 195/373] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:38.644050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac2ea-6646-48e7-8e72-d080751ecb29 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:38.644347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac2ea-6646-48e7-8e72-d080751ecb29 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:38.644631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fac2ea-6646-48e7-8e72-d080751ecb29 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:38.651280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 196/374] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:38.652237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fac2ea-6646-48e7-8e72-d080751ecb29 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:38.673265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 179/375] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:38.674921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856b27-5975-444c-a27f-fe4c859a1eaa None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:38.675446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856b27-5975-444c-a27f-fe4c859a1eaa None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:38.675931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856b27-5975-444c-a27f-fe4c859a1eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:38.713438 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-77856b27-5975-444c-a27f-fe4c859a1eaa None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:38.714698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-77856b27-5975-444c-a27f-fe4c859a1eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:38.796592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fac2ea-6646-48e7-8e72-d080751ecb29 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:38.801820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 180/376] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:38.802878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856b27-5975-444c-a27f-fe4c859a1eaa None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:38.825637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:38.832336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:38.848500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8be007-727c-4da2-b7b2-c00c15369977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:38.849680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8be007-727c-4da2-b7b2-c00c15369977 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:38.850192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8be007-727c-4da2-b7b2-c00c15369977 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:38.850676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8be007-727c-4da2-b7b2-c00c15369977 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:38.853231 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8be007-727c-4da2-b7b2-c00c15369977 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:38.855410 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8be007-727c-4da2-b7b2-c00c15369977 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:38.858347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 197/377] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:38 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:38.859354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8be007-727c-4da2-b7b2-c00c15369977 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:38.951113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856b27-5975-444c-a27f-fe4c859a1eaa None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:38.997299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772389da-dee8-4a4a-8b96-e64209b8593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:38.998250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772389da-dee8-4a4a-8b96-e64209b8593e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:38.998529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772389da-dee8-4a4a-8b96-e64209b8593e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:38.998801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772389da-dee8-4a4a-8b96-e64209b8593e None admin] PATH_INFO: `/v3/projects/53f35d51b66c4aec847015cb4a904c77` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:38.999234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8be007-727c-4da2-b7b2-c00c15369977 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:39.001405 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772389da-dee8-4a4a-8b96-e64209b8593e None admin] RBAC: Authorizing `identity:get_project(project_id=53f35d51b66c4aec847015cb4a904c77)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:39.003883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772389da-dee8-4a4a-8b96-e64209b8593e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:39.005626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 181/378] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:38 2022] GET /identity/v3/projects/53f35d51b66c4aec847015cb4a904c77 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:39.006434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772389da-dee8-4a4a-8b96-e64209b8593e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:39.051691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64d775-f6d6-4f29-b206-8564db9bb209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:39.053050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64d775-f6d6-4f29-b206-8564db9bb209 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:39.053516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64d775-f6d6-4f29-b206-8564db9bb209 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:39.053968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64d775-f6d6-4f29-b206-8564db9bb209 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:39.078653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64d775-f6d6-4f29-b206-8564db9bb209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8e64d775-f6d6-4f29-b206-8564db9bb209 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:39.085419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:39.086368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:39.087797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 198/379] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:39.088968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64d775-f6d6-4f29-b206-8564db9bb209 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:39.136168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:39.145757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:39.150177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772389da-dee8-4a4a-8b96-e64209b8593e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:39.190041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed04d4e-06df-43da-ab67-108b91636731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:39.191323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed04d4e-06df-43da-ab67-108b91636731 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:39.191908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed04d4e-06df-43da-ab67-108b91636731 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:39.192384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed04d4e-06df-43da-ab67-108b91636731 None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:39.194301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed04d4e-06df-43da-ab67-108b91636731 None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:39.196834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed04d4e-06df-43da-ab67-108b91636731 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:39.199174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 182/380] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:39 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:39.200221 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed04d4e-06df-43da-ab67-108b91636731 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:39.207397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64d775-f6d6-4f29-b206-8564db9bb209 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:39.245501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e281-fb71-4b47-a463-3b34a9e31c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:39.246446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e281-fb71-4b47-a463-3b34a9e31c91 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:39.246737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e281-fb71-4b47-a463-3b34a9e31c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:39.247021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e281-fb71-4b47-a463-3b34a9e31c91 None admin] PATH_INFO: `/v3/groups/96032242530d4799af7448de0ee947d1` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:39.252140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9e281-fb71-4b47-a463-3b34a9e31c91 None admin] RBAC: Authorizing `identity:get_group(group_id=96032242530d4799af7448de0ee947d1)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:39.253646 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9e281-fb71-4b47-a463-3b34a9e31c91 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:39.255677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 199/381] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:39 2022] GET /identity/v3/groups/96032242530d4799af7448de0ee947d1 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:39.256492 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e281-fb71-4b47-a463-3b34a9e31c91 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:39.330809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed04d4e-06df-43da-ab67-108b91636731 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:39.369165 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5005469-f698-4776-964c-43bec03467c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:39.370217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5005469-f698-4776-964c-43bec03467c0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:39.370525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5005469-f698-4776-964c-43bec03467c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:39.370800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5005469-f698-4776-964c-43bec03467c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:39.371431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e281-fb71-4b47-a463-3b34a9e31c91 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:39.371542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5005469-f698-4776-964c-43bec03467c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:39.371850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5005469-f698-4776-964c-43bec03467c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:39.373350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5005469-f698-4776-964c-43bec03467c0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:39.382463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 183/382] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:39.383455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5005469-f698-4776-964c-43bec03467c0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:39.387120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:39.411528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0947981-100f-481a-bc10-1c895f2e62dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:39.412236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0947981-100f-481a-bc10-1c895f2e62dd None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:39.412521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0947981-100f-481a-bc10-1c895f2e62dd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:39.412797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0947981-100f-481a-bc10-1c895f2e62dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:39.413068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:39.413644 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0947981-100f-481a-bc10-1c895f2e62dd None admin] RBAC: Adding query filter params (group.id=27a1e7c050ff43b9bcfd1e35fbc6650c, role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:39.413954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0947981-100f-481a-bc10-1c895f2e62dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:39.416133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0947981-100f-481a-bc10-1c895f2e62dd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:39.422122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 200/383] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 11 13:59:39 2022] GET /identity/v3/role_assignments?group.id=27a1e7c050ff43b9bcfd1e35fbc6650c&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:39.422944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0947981-100f-481a-bc10-1c895f2e62dd None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:39.501915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5005469-f698-4776-964c-43bec03467c0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:39.542649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946802da-bfa1-49f6-9db2-93795a86531f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:39.543435 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946802da-bfa1-49f6-9db2-93795a86531f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:39.543591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946802da-bfa1-49f6-9db2-93795a86531f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:39.546179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946802da-bfa1-49f6-9db2-93795a86531f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:39.546179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946802da-bfa1-49f6-9db2-93795a86531f None admin] RBAC: Adding query filter params (group.id=96032242530d4799af7448de0ee947d1, role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=53f35d51b66c4aec847015cb4a904c77) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:39.546179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946802da-bfa1-49f6-9db2-93795a86531f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:39.546678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946802da-bfa1-49f6-9db2-93795a86531f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:39.554395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 184/384] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 11 13:59:39 2022] GET /identity/v3/role_assignments?group.id=96032242530d4799af7448de0ee947d1&scope.project.id=53f35d51b66c4aec847015cb4a904c77&role.id=57f1335a97b5490cb0853894c2faf62c => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:39.596834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0947981-100f-481a-bc10-1c895f2e62dd None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:39.660472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822517e-b1e2-4ca1-89ba-1c302cbddaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:39.661363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822517e-b1e2-4ca1-89ba-1c302cbddaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:39.661648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822517e-b1e2-4ca1-89ba-1c302cbddaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:39.661927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822517e-b1e2-4ca1-89ba-1c302cbddaf4 None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:39.663280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822517e-b1e2-4ca1-89ba-1c302cbddaf4 None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:39.664745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822517e-b1e2-4ca1-89ba-1c302cbddaf4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:39.667834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 201/385] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:39 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:39.673494 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946802da-bfa1-49f6-9db2-93795a86531f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:39.785683 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:39.806050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946802da-bfa1-49f6-9db2-93795a86531f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:39.844327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fac241-7ea4-40a1-8a81-65dfd059387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:39.845248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac241-7ea4-40a1-8a81-65dfd059387e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:39.845535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac241-7ea4-40a1-8a81-65dfd059387e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:39.845814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac241-7ea4-40a1-8a81-65dfd059387e None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:39.847105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fac241-7ea4-40a1-8a81-65dfd059387e None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:39.848489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fac241-7ea4-40a1-8a81-65dfd059387e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:39.850539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 185/386] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:39 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:39.856552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822517e-b1e2-4ca1-89ba-1c302cbddaf4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:39.936403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:40.001791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822517e-b1e2-4ca1-89ba-1c302cbddaf4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:40.042437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b5d29-6554-4514-a944-5940afeca217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:40.043350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b5d29-6554-4514-a944-5940afeca217 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:40.043638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b5d29-6554-4514-a944-5940afeca217 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:40.043915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b5d29-6554-4514-a944-5940afeca217 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336/groups/27a1e7c050ff43b9bcfd1e35fbc6650c/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:40.045901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b5d29-6554-4514-a944-5940afeca217 None admin] RBAC: Authorizing `identity:create_grant(project_id=d94efb6a61fb468abaff458dda955336, group_id=27a1e7c050ff43b9bcfd1e35fbc6650c, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:40.047410 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b5d29-6554-4514-a944-5940afeca217 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:40.065962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 202/387] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Jul 11 13:59:39 2022] PUT /identity/v3/projects/d94efb6a61fb468abaff458dda955336/groups/27a1e7c050ff43b9bcfd1e35fbc6650c/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:40.689111 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f1f60-fda3-49e7-8d05-1ea24d5807ae None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:40.691504 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3bad-54e4-400b-9a90-6a92c93d39fc None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:40.692276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3bad-54e4-400b-9a90-6a92c93d39fc None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:40.692784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f1f60-fda3-49e7-8d05-1ea24d5807ae None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:40.693258 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3bad-54e4-400b-9a90-6a92c93d39fc None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:40.693735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f1f60-fda3-49e7-8d05-1ea24d5807ae None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:40.698282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 203/388] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:40.698744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 186/389] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:40.703424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc3d0c-bd85-48a1-9903-95d51dc0f00c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:40.703956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc3d0c-bd85-48a1-9903-95d51dc0f00c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:40.704452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc3d0c-bd85-48a1-9903-95d51dc0f00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:40.714007 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec387752-790c-4252-8312-1dac8c5f9988 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:40.714639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec387752-790c-4252-8312-1dac8c5f9988 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:40.715140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec387752-790c-4252-8312-1dac8c5f9988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:40.731293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-53dc3d0c-bd85-48a1-9903-95d51dc0f00c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:40.732528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-53dc3d0c-bd85-48a1-9903-95d51dc0f00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:40.745297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ec387752-790c-4252-8312-1dac8c5f9988 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:40.746562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ec387752-790c-4252-8312-1dac8c5f9988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:40.848524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 204/390] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:40.853647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 187/391] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:40.876832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc3d0c-bd85-48a1-9903-95d51dc0f00c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:40.893408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec387752-790c-4252-8312-1dac8c5f9988 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:40.937561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:41.009696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:41.028522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec387752-790c-4252-8312-1dac8c5f9988 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:41.067569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3380-b64c-4690-8376-8b3c3751e4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:41.068653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3380-b64c-4690-8376-8b3c3751e4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:41.069090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3380-b64c-4690-8376-8b3c3751e4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:41.069514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3380-b64c-4690-8376-8b3c3751e4d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:41.082413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb3380-b64c-4690-8376-8b3c3751e4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b1eb3380-b64c-4690-8376-8b3c3751e4d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:41.091601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:41.092769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:41.093753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:41.096240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 188/392] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:41.111237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3380-b64c-4690-8376-8b3c3751e4d6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:41.112081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc3d0c-bd85-48a1-9903-95d51dc0f00c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:41.155293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855db43-72ec-424b-a579-cd6b6d25eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:41.156367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855db43-72ec-424b-a579-cd6b6d25eafa None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:41.156967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855db43-72ec-424b-a579-cd6b6d25eafa None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:41.158466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4855db43-72ec-424b-a579-cd6b6d25eafa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:41.183560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4855db43-72ec-424b-a579-cd6b6d25eafa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-4855db43-72ec-424b-a579-cd6b6d25eafa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:41.193510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:41.194671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:41.195725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:41.210083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 205/393] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:41.213303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855db43-72ec-424b-a579-cd6b6d25eafa None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:41.317392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3380-b64c-4690-8376-8b3c3751e4d6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:41.398511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:41.409359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4855db43-72ec-424b-a579-cd6b6d25eafa None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:41.411427 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eafda0-8347-4fd8-9342-f855154f2849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:41.412107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eafda0-8347-4fd8-9342-f855154f2849 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:41.412389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eafda0-8347-4fd8-9342-f855154f2849 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:41.412663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eafda0-8347-4fd8-9342-f855154f2849 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:41.413420 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eafda0-8347-4fd8-9342-f855154f2849 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:41.413721 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eafda0-8347-4fd8-9342-f855154f2849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:41.415388 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eafda0-8347-4fd8-9342-f855154f2849 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:41.436707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 189/394] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:41.443191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eafda0-8347-4fd8-9342-f855154f2849 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:41.462597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:41.491203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ce57c-71ae-47f5-a2d8-df581e3108b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:41.491882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ce57c-71ae-47f5-a2d8-df581e3108b0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:41.492168 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ce57c-71ae-47f5-a2d8-df581e3108b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:41.492442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ce57c-71ae-47f5-a2d8-df581e3108b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:41.493925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ce57c-71ae-47f5-a2d8-df581e3108b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:41.494426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ce57c-71ae-47f5-a2d8-df581e3108b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:41.495819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ce57c-71ae-47f5-a2d8-df581e3108b0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:41.520371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 206/395] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:41.531180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ce57c-71ae-47f5-a2d8-df581e3108b0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:41.582652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eafda0-8347-4fd8-9342-f855154f2849 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:41.624158 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61392337-4527-4cde-95a6-d1cbe68da291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:41.625494 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392337-4527-4cde-95a6-d1cbe68da291 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:41.630549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392337-4527-4cde-95a6-d1cbe68da291 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:41.630840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61392337-4527-4cde-95a6-d1cbe68da291 None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:41.632836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61392337-4527-4cde-95a6-d1cbe68da291 None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:41.635213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61392337-4527-4cde-95a6-d1cbe68da291 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:41.639664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 190/396] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:41 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:41.647185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61392337-4527-4cde-95a6-d1cbe68da291 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:41.735821 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:41.769642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61392337-4527-4cde-95a6-d1cbe68da291 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:41.808004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ce57c-71ae-47f5-a2d8-df581e3108b0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:41.850181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388d7a-e5e0-4ce2-a28b-5fb63c5fabca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:41.851008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf09fe-c7c8-4f30-a415-84f0b2357d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:41.852065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388d7a-e5e0-4ce2-a28b-5fb63c5fabca None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:41.853952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf09fe-c7c8-4f30-a415-84f0b2357d6d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:41.854416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388d7a-e5e0-4ce2-a28b-5fb63c5fabca None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:41.854852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388d7a-e5e0-4ce2-a28b-5fb63c5fabca None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:41.856247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388d7a-e5e0-4ce2-a28b-5fb63c5fabca None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:41.856673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf09fe-c7c8-4f30-a415-84f0b2357d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:41.857095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf09fe-c7c8-4f30-a415-84f0b2357d6d None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:41.859265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388d7a-e5e0-4ce2-a28b-5fb63c5fabca None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:41.860068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf09fe-c7c8-4f30-a415-84f0b2357d6d None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:41.861638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf09fe-c7c8-4f30-a415-84f0b2357d6d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:41.863488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 207/397] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:41 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:41.865606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 191/398] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:41 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:41.871281 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388d7a-e5e0-4ce2-a28b-5fb63c5fabca None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:41.872491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf09fe-c7c8-4f30-a415-84f0b2357d6d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:41.934600 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:41.986431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf09fe-c7c8-4f30-a415-84f0b2357d6d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:42.026867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d9288-b312-4a25-870e-4bccbdf26aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:42.028130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9288-b312-4a25-870e-4bccbdf26aa0 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.028616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9288-b312-4a25-870e-4bccbdf26aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.029089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d9288-b312-4a25-870e-4bccbdf26aa0 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336/groups/27a1e7c050ff43b9bcfd1e35fbc6650c/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.032102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d9288-b312-4a25-870e-4bccbdf26aa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d94efb6a61fb468abaff458dda955336, group_id=27a1e7c050ff43b9bcfd1e35fbc6650c, role_id=a9fb1d2d70d24a29a0fad5800c9ea0f7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:42.033753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d9288-b312-4a25-870e-4bccbdf26aa0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:42.049246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 192/399] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Jul 11 13:59:41 2022] PUT /identity/v3/projects/d94efb6a61fb468abaff458dda955336/groups/27a1e7c050ff43b9bcfd1e35fbc6650c/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:42.151497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388d7a-e5e0-4ce2-a28b-5fb63c5fabca None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:42.225109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd7c71-a73f-4821-9614-4f87fbaebf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:42.226347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7c71-a73f-4821-9614-4f87fbaebf15 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.226858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7c71-a73f-4821-9614-4f87fbaebf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.227930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd7c71-a73f-4821-9614-4f87fbaebf15 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.229762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7c71-a73f-4821-9614-4f87fbaebf15 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:42.231529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd7c71-a73f-4821-9614-4f87fbaebf15 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:42.233448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 208/400] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:41 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:42.239307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d9288-b312-4a25-870e-4bccbdf26aa0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:42.242633 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:42.318039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e70b5-6cb8-47d6-bab5-fcab6712fc9e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.318767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e70b5-6cb8-47d6-bab5-fcab6712fc9e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.319253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e70b5-6cb8-47d6-bab5-fcab6712fc9e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.320837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 209/401] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:42.328752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2a51-cafb-4569-8ff2-8505f5dce1f6 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.328752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2a51-cafb-4569-8ff2-8505f5dce1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.328752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2a51-cafb-4569-8ff2-8505f5dce1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.347357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-eeed2a51-cafb-4569-8ff2-8505f5dce1f6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:42.348910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-eeed2a51-cafb-4569-8ff2-8505f5dce1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:42.390456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d9288-b312-4a25-870e-4bccbdf26aa0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:42.426419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 210/402] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:42.428082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865fb8a-6ea4-4cb4-9b74-1c6aa38bb958 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.428199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96364ec0-c4cd-4afb-a93c-c06c16dea12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:42.428729 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865fb8a-6ea4-4cb4-9b74-1c6aa38bb958 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.429029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96364ec0-c4cd-4afb-a93c-c06c16dea12b None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.429313 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96364ec0-c4cd-4afb-a93c-c06c16dea12b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.429652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96364ec0-c4cd-4afb-a93c-c06c16dea12b None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/groups/27a1e7c050ff43b9bcfd1e35fbc6650c/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.429753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865fb8a-6ea4-4cb4-9b74-1c6aa38bb958 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.432289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 211/403] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:42.432475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96364ec0-c4cd-4afb-a93c-c06c16dea12b None admin] RBAC: Authorizing `identity:create_grant(project_id=bf2fd0aef6ed4a1b97eab01228b80cac, group_id=27a1e7c050ff43b9bcfd1e35fbc6650c, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:42.433885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96364ec0-c4cd-4afb-a93c-c06c16dea12b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:42.441436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbcda9-481d-43f8-ac00-e144dc28728b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.442059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbcda9-481d-43f8-ac00-e144dc28728b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.442735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dbcda9-481d-43f8-ac00-e144dc28728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.455953 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 193/404] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Jul 11 13:59:42 2022] PUT /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/groups/27a1e7c050ff43b9bcfd1e35fbc6650c/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:42.456782 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96364ec0-c4cd-4afb-a93c-c06c16dea12b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:42.464545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-34dbcda9-481d-43f8-ac00-e144dc28728b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:42.465778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-34dbcda9-481d-43f8-ac00-e144dc28728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:42.486991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:42.547164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 212/405] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:42.548730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475056-48bc-4374-b8d5-8a58d134cd92 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.549065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475056-48bc-4374-b8d5-8a58d134cd92 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.549392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475056-48bc-4374-b8d5-8a58d134cd92 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.554605 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 213/406] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:42.557679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b197b2f-4bc1-402a-9e82-2f1bdac5fc6b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.557966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b197b2f-4bc1-402a-9e82-2f1bdac5fc6b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.558269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b197b2f-4bc1-402a-9e82-2f1bdac5fc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.561746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:42.584508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-3b197b2f-4bc1-402a-9e82-2f1bdac5fc6b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:42.585827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3b197b2f-4bc1-402a-9e82-2f1bdac5fc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:42.623924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96364ec0-c4cd-4afb-a93c-c06c16dea12b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:42.670120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9107318-ddee-4d09-974c-d02324296972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:42.671031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107318-ddee-4d09-974c-d02324296972 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.671349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107318-ddee-4d09-974c-d02324296972 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.671629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9107318-ddee-4d09-974c-d02324296972 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.682944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 214/407] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:42.682944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b197b2f-4bc1-402a-9e82-2f1bdac5fc6b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:42.696560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9107318-ddee-4d09-974c-d02324296972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b9107318-ddee-4d09-974c-d02324296972 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:42.705689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:42.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:42.707566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 194/408] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:42.713815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9107318-ddee-4d09-974c-d02324296972 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:42.781382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:42.803448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b197b2f-4bc1-402a-9e82-2f1bdac5fc6b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:42.828680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9107318-ddee-4d09-974c-d02324296972 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:42.842735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b636115-c737-4e37-8730-70dd4db1b755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:42.844243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b636115-c737-4e37-8730-70dd4db1b755 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.844677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b636115-c737-4e37-8730-70dd4db1b755 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.845114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b636115-c737-4e37-8730-70dd4db1b755 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.853972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:42.859110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b636115-c737-4e37-8730-70dd4db1b755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:42.867113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dfcb6-a846-4ec5-8eb7-0dcf9e833056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8b636115-c737-4e37-8730-70dd4db1b755 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:42.868079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:42.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:42.870042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:42.870684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dfcb6-a846-4ec5-8eb7-0dcf9e833056 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:42.870684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dfcb6-a846-4ec5-8eb7-0dcf9e833056 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:42.870684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dfcb6-a846-4ec5-8eb7-0dcf9e833056 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:42.872554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 215/409] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:42.873685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b636115-c737-4e37-8730-70dd4db1b755 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:42.887520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dfcb6-a846-4ec5-8eb7-0dcf9e833056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a20dfcb6-a846-4ec5-8eb7-0dcf9e833056 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:42.896289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:42.897195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:42.898436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:42.902518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 195/410] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:42.906147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dfcb6-a846-4ec5-8eb7-0dcf9e833056 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:42.985258 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b636115-c737-4e37-8730-70dd4db1b755 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:43.016644 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dfcb6-a846-4ec5-8eb7-0dcf9e833056 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:43.021414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e21e77-05e4-4f6b-89ca-a3fdd9e20402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:43.022350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e21e77-05e4-4f6b-89ca-a3fdd9e20402 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:43.022815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e21e77-05e4-4f6b-89ca-a3fdd9e20402 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:43.023271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e21e77-05e4-4f6b-89ca-a3fdd9e20402 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:43.024779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e21e77-05e4-4f6b-89ca-a3fdd9e20402 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:43.025422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e21e77-05e4-4f6b-89ca-a3fdd9e20402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:43.027037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e21e77-05e4-4f6b-89ca-a3fdd9e20402 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:43.035955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 216/411] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:43.037169 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e21e77-05e4-4f6b-89ca-a3fdd9e20402 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:43.042319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:43.056305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8734a3a-db5e-442d-94da-4cfbf4e6b612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:43.057519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734a3a-db5e-442d-94da-4cfbf4e6b612 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:43.057800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734a3a-db5e-442d-94da-4cfbf4e6b612 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:43.058352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8734a3a-db5e-442d-94da-4cfbf4e6b612 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:43.059503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8734a3a-db5e-442d-94da-4cfbf4e6b612 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:43.059811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8734a3a-db5e-442d-94da-4cfbf4e6b612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:43.061198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8734a3a-db5e-442d-94da-4cfbf4e6b612 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:43.073983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 196/412] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:43.074856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8734a3a-db5e-442d-94da-4cfbf4e6b612 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:43.158278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e21e77-05e4-4f6b-89ca-a3fdd9e20402 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:43.158910 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:43.199447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8734a3a-db5e-442d-94da-4cfbf4e6b612 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:43.204965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b429cd3-aefe-40ca-963c-1e252bf2659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:43.205655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429cd3-aefe-40ca-963c-1e252bf2659e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:43.205946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429cd3-aefe-40ca-963c-1e252bf2659e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:43.206250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429cd3-aefe-40ca-963c-1e252bf2659e None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:43.207023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b429cd3-aefe-40ca-963c-1e252bf2659e None admin] RBAC: Adding query filter params (name=member) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:43.207334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b429cd3-aefe-40ca-963c-1e252bf2659e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:43.208722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b429cd3-aefe-40ca-963c-1e252bf2659e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:43.218735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 217/413] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:43.219984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b429cd3-aefe-40ca-963c-1e252bf2659e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:43.253308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b082041-9264-4ccf-9d05-3b685ff54063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:43.254102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b082041-9264-4ccf-9d05-3b685ff54063 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:43.254413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b082041-9264-4ccf-9d05-3b685ff54063 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:43.254686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b082041-9264-4ccf-9d05-3b685ff54063 None admin] PATH_INFO: `/v3/groups/96032242530d4799af7448de0ee947d1` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:43.255874 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b082041-9264-4ccf-9d05-3b685ff54063 None admin] RBAC: Authorizing `identity:get_group(group_id=96032242530d4799af7448de0ee947d1)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:43.257317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b082041-9264-4ccf-9d05-3b685ff54063 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:43.260022 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 197/414] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:43 2022] GET /identity/v3/groups/96032242530d4799af7448de0ee947d1 => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:43.260784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b082041-9264-4ccf-9d05-3b685ff54063 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:43.303076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:43.352140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b429cd3-aefe-40ca-963c-1e252bf2659e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:43.376339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b082041-9264-4ccf-9d05-3b685ff54063 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:43.390812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:43.403870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff2dbf-d0a8-4c3c-bcbf-598f789984f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:43.405029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2dbf-d0a8-4c3c-bcbf-598f789984f3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:43.405326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2dbf-d0a8-4c3c-bcbf-598f789984f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:43.405610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff2dbf-d0a8-4c3c-bcbf-598f789984f3 None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:43.407103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff2dbf-d0a8-4c3c-bcbf-598f789984f3 None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:43.409279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff2dbf-d0a8-4c3c-bcbf-598f789984f3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:43.416443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 218/415] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:43 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:43.416443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff2dbf-d0a8-4c3c-bcbf-598f789984f3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:43.421164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cb9c1-5dbf-4d02-8402-af68b5b5a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:43.421990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cb9c1-5dbf-4d02-8402-af68b5b5a76b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:43.422484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cb9c1-5dbf-4d02-8402-af68b5b5a76b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:43.422918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cb9c1-5dbf-4d02-8402-af68b5b5a76b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:43.497973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cb9c1-5dbf-4d02-8402-af68b5b5a76b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:43.499678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cb9c1-5dbf-4d02-8402-af68b5b5a76b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:43.556306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff2dbf-d0a8-4c3c-bcbf-598f789984f3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:43.603540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a817c-67f5-45b4-8086-3cac6f82a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:43.604517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a817c-67f5-45b4-8086-3cac6f82a860 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:43.604881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a817c-67f5-45b4-8086-3cac6f82a860 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:43.605237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a817c-67f5-45b4-8086-3cac6f82a860 None admin] PATH_INFO: `/v3/projects/53f35d51b66c4aec847015cb4a904c77` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:43.605738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 198/416] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:43.606567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a817c-67f5-45b4-8086-3cac6f82a860 None admin] RBAC: Authorizing `identity:get_project(project_id=53f35d51b66c4aec847015cb4a904c77)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:43.606917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cb9c1-5dbf-4d02-8402-af68b5b5a76b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:43.608243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a817c-67f5-45b4-8086-3cac6f82a860 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:43.611602 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 219/417] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:43 2022] GET /identity/v3/projects/53f35d51b66c4aec847015cb4a904c77 => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:43.612538 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a817c-67f5-45b4-8086-3cac6f82a860 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:43.615348 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:43.624512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:43.720433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cb9c1-5dbf-4d02-8402-af68b5b5a76b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:43.757950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a817c-67f5-45b4-8086-3cac6f82a860 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:43.771274 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b69e-c277-415d-9379-a0c3a0f62430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:43.772528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b69e-c277-415d-9379-a0c3a0f62430 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:43.772885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b69e-c277-415d-9379-a0c3a0f62430 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:43.773237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b69e-c277-415d-9379-a0c3a0f62430 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:43.774796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75b69e-c277-415d-9379-a0c3a0f62430 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:43.776262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75b69e-c277-415d-9379-a0c3a0f62430 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:43.778002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 199/418] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:43 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:43.780162 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b69e-c277-415d-9379-a0c3a0f62430 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:43.814723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cfe99-3a88-4fe3-96ec-1bf0390f9019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:43.815776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cfe99-3a88-4fe3-96ec-1bf0390f9019 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:43.816085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cfe99-3a88-4fe3-96ec-1bf0390f9019 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:43.816763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40cfe99-3a88-4fe3-96ec-1bf0390f9019 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:43.818299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cfe99-3a88-4fe3-96ec-1bf0390f9019 None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:43.820640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40cfe99-3a88-4fe3-96ec-1bf0390f9019 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:43.826247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 220/419] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:43 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:43.827090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cfe99-3a88-4fe3-96ec-1bf0390f9019 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:43.880939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:43.908753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b69e-c277-415d-9379-a0c3a0f62430 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:43.915317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:43.953267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40cfe99-3a88-4fe3-96ec-1bf0390f9019 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:43.958649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479147e0-5126-464e-86aa-8756b7c4ce88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:43.959802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479147e0-5126-464e-86aa-8756b7c4ce88 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:43.960279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479147e0-5126-464e-86aa-8756b7c4ce88 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:43.961337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479147e0-5126-464e-86aa-8756b7c4ce88 None admin] PATH_INFO: `/v3/projects/53f35d51b66c4aec847015cb4a904c77/groups/96032242530d4799af7448de0ee947d1/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:43.966885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479147e0-5126-464e-86aa-8756b7c4ce88 None admin] RBAC: Authorizing `identity:create_grant(project_id=53f35d51b66c4aec847015cb4a904c77, group_id=96032242530d4799af7448de0ee947d1, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:43.969461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479147e0-5126-464e-86aa-8756b7c4ce88 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:43.989379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 200/420] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Jul 11 13:59:43 2022] PUT /identity/v3/projects/53f35d51b66c4aec847015cb4a904c77/groups/96032242530d4799af7448de0ee947d1/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:43.990620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479147e0-5126-464e-86aa-8756b7c4ce88 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:44.013981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b3e4e-fb5a-47a9-a716-6ccd65a629f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:44.015214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3e4e-fb5a-47a9-a716-6ccd65a629f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:44.015509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3e4e-fb5a-47a9-a716-6ccd65a629f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:44.015789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b3e4e-fb5a-47a9-a716-6ccd65a629f6 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/groups/27a1e7c050ff43b9bcfd1e35fbc6650c/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:44.020551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b3e4e-fb5a-47a9-a716-6ccd65a629f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf2fd0aef6ed4a1b97eab01228b80cac, group_id=27a1e7c050ff43b9bcfd1e35fbc6650c, role_id=a9fb1d2d70d24a29a0fad5800c9ea0f7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:44.027574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b3e4e-fb5a-47a9-a716-6ccd65a629f6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:44.050826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 221/421] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Jul 11 13:59:43 2022] PUT /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac/groups/27a1e7c050ff43b9bcfd1e35fbc6650c/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 13:59:44.141349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479147e0-5126-464e-86aa-8756b7c4ce88 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:44.190937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d51db-7131-4699-82eb-7b0dd43f91c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:44.191988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d51db-7131-4699-82eb-7b0dd43f91c9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:44.192425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d51db-7131-4699-82eb-7b0dd43f91c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:44.192796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d51db-7131-4699-82eb-7b0dd43f91c9 None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:44.194329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d51db-7131-4699-82eb-7b0dd43f91c9 None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:44.196444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d51db-7131-4699-82eb-7b0dd43f91c9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:44.198755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 201/422] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:43 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:44.205108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b3e4e-fb5a-47a9-a716-6ccd65a629f6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:44.309155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba40b5-9fdc-4298-a401-fbeb8efb7e7f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:44.309596 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba40b5-9fdc-4298-a401-fbeb8efb7e7f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:44.309987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba40b5-9fdc-4298-a401-fbeb8efb7e7f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:44.312927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 202/423] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:44.324441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf141e-86dc-4ad0-adc1-98992ef45229 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:44.324879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf141e-86dc-4ad0-adc1-98992ef45229 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:44.325257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf141e-86dc-4ad0-adc1-98992ef45229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:44.350915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8acf141e-86dc-4ad0-adc1-98992ef45229 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:44.352331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8acf141e-86dc-4ad0-adc1-98992ef45229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:44.352672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b3e4e-fb5a-47a9-a716-6ccd65a629f6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:44.364597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:44.393762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:44.400048 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69359eca-4052-4c90-853a-4ade2eae2ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:44.400910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69359eca-4052-4c90-853a-4ade2eae2ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:44.401196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69359eca-4052-4c90-853a-4ade2eae2ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:44.401483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69359eca-4052-4c90-853a-4ade2eae2ac2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:44.402406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69359eca-4052-4c90-853a-4ade2eae2ac2 None admin] RBAC: Adding query filter params (group.id=27a1e7c050ff43b9bcfd1e35fbc6650c, role.id=8b1dade745704cf3a2a92b5ac07853b4, scope.project.id=d94efb6a61fb468abaff458dda955336) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:44.402900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69359eca-4052-4c90-853a-4ade2eae2ac2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:44.404751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69359eca-4052-4c90-853a-4ade2eae2ac2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:44.414241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 222/424] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 11 13:59:44 2022] GET /identity/v3/role_assignments?group.id=27a1e7c050ff43b9bcfd1e35fbc6650c&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:44.471905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 203/425] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:44.519856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69359eca-4052-4c90-853a-4ade2eae2ac2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:44.637660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69359eca-4052-4c90-853a-4ade2eae2ac2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:44.676413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d87bb8-3d02-4a72-99cd-e5056750ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:44.677505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d87bb8-3d02-4a72-99cd-e5056750ab1f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:44.677962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d87bb8-3d02-4a72-99cd-e5056750ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:44.678461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d87bb8-3d02-4a72-99cd-e5056750ab1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:44.690534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d87bb8-3d02-4a72-99cd-e5056750ab1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-02d87bb8-3d02-4a72-99cd-e5056750ab1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:44.699145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:44.700292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:44.701327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:44.703869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 223/426] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:44.709875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf141e-86dc-4ad0-adc1-98992ef45229 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:44.843033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf141e-86dc-4ad0-adc1-98992ef45229 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:44.883925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ae700-600b-40b1-ac9e-b7d9c86f23cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:44.885331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ae700-600b-40b1-ac9e-b7d9c86f23cb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:44.885780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ae700-600b-40b1-ac9e-b7d9c86f23cb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:44.888423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ae700-600b-40b1-ac9e-b7d9c86f23cb None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:44.889448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ae700-600b-40b1-ac9e-b7d9c86f23cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:44.889934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ae700-600b-40b1-ac9e-b7d9c86f23cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:44.891614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ae700-600b-40b1-ac9e-b7d9c86f23cb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:44.898477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:44.905454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 204/427] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:44.911496 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d87bb8-3d02-4a72-99cd-e5056750ab1f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:44.920176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c66746-c034-4a0c-88f7-08eeed1ed53d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:44.920464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c66746-c034-4a0c-88f7-08eeed1ed53d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:44.920752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c66746-c034-4a0c-88f7-08eeed1ed53d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:44.926208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 205/428] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:44.927646 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49943be9-b8d3-45f4-b972-767b9b9098b4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:44.927907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49943be9-b8d3-45f4-b972-767b9b9098b4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:44.928159 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49943be9-b8d3-45f4-b972-767b9b9098b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:44.951171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-49943be9-b8d3-45f4-b972-767b9b9098b4 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:44.952389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-49943be9-b8d3-45f4-b972-767b9b9098b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:44.995730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:45.029795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 206/429] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:45.054433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49943be9-b8d3-45f4-b972-767b9b9098b4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:45.058011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d87bb8-3d02-4a72-99cd-e5056750ab1f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:45.105463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec5e6f-5dcf-4176-9b4c-f5dd324a7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:45.106525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5e6f-5dcf-4176-9b4c-f5dd324a7edd None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:45.107019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5e6f-5dcf-4176-9b4c-f5dd324a7edd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:45.107499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5e6f-5dcf-4176-9b4c-f5dd324a7edd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:45.175818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49943be9-b8d3-45f4-b972-767b9b9098b4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:45.194450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec5e6f-5dcf-4176-9b4c-f5dd324a7edd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:45.196849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec5e6f-5dcf-4176-9b4c-f5dd324a7edd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:45.208346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:45.215560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd33ff9-d3ca-49c4-93fe-aab88b756d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:45.216380 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd33ff9-d3ca-49c4-93fe-aab88b756d75 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:45.216671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd33ff9-d3ca-49c4-93fe-aab88b756d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:45.217017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd33ff9-d3ca-49c4-93fe-aab88b756d75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:45.229822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd33ff9-d3ca-49c4-93fe-aab88b756d75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1cd33ff9-d3ca-49c4-93fe-aab88b756d75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:45.238203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:45.239164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:45.239973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 207/430] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:45.245846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd33ff9-d3ca-49c4-93fe-aab88b756d75 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:45.264957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:45.321082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 224/431] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:45.327484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec5e6f-5dcf-4176-9b4c-f5dd324a7edd None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:45.384841 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd33ff9-d3ca-49c4-93fe-aab88b756d75 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:45.427159 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08109a-d428-4329-9896-d979c81b6587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:45.427978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08109a-d428-4329-9896-d979c81b6587 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:45.428352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08109a-d428-4329-9896-d979c81b6587 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:45.428729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08109a-d428-4329-9896-d979c81b6587 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:45.429597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08109a-d428-4329-9896-d979c81b6587 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:45.429984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08109a-d428-4329-9896-d979c81b6587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:45.432300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08109a-d428-4329-9896-d979c81b6587 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:45.446719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 208/432] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 13:59:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:45.448519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08109a-d428-4329-9896-d979c81b6587 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:45.476740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec5e6f-5dcf-4176-9b4c-f5dd324a7edd None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:45.529438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67873dd-4087-4823-8b56-64597d69a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:45.530430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67873dd-4087-4823-8b56-64597d69a1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:45.530718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67873dd-4087-4823-8b56-64597d69a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:45.531001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67873dd-4087-4823-8b56-64597d69a1e5 None admin] PATH_INFO: `/v3/projects/d94efb6a61fb468abaff458dda955336` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:45.532519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67873dd-4087-4823-8b56-64597d69a1e5 None admin] RBAC: Authorizing `identity:get_project(project_id=d94efb6a61fb468abaff458dda955336)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:45.534120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67873dd-4087-4823-8b56-64597d69a1e5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:45.538053 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 225/433] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:45 2022] GET /identity/v3/projects/d94efb6a61fb468abaff458dda955336 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:45.538550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:45.543450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67873dd-4087-4823-8b56-64597d69a1e5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:45.570981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08109a-d428-4329-9896-d979c81b6587 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:45.583742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:45.615136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14540c-b0e1-4e4a-ac0d-e6595e1cd556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:45.616032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14540c-b0e1-4e4a-ac0d-e6595e1cd556 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:45.616389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14540c-b0e1-4e4a-ac0d-e6595e1cd556 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:45.616756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14540c-b0e1-4e4a-ac0d-e6595e1cd556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:45.697622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67873dd-4087-4823-8b56-64597d69a1e5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:45.705144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14540c-b0e1-4e4a-ac0d-e6595e1cd556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:45.706914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14540c-b0e1-4e4a-ac0d-e6595e1cd556 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:45.748852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72c502-635b-4c06-b6ad-f4f5c58e2d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:45.750296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72c502-635b-4c06-b6ad-f4f5c58e2d7d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:45.750721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72c502-635b-4c06-b6ad-f4f5c58e2d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:45.751135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72c502-635b-4c06-b6ad-f4f5c58e2d7d None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:45.753642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72c502-635b-4c06-b6ad-f4f5c58e2d7d None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:45.755287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72c502-635b-4c06-b6ad-f4f5c58e2d7d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:45.757430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 226/434] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:45 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:45.765880 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72c502-635b-4c06-b6ad-f4f5c58e2d7d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:45.778583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:45.844282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 209/435] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 11 13:59:45.845363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14540c-b0e1-4e4a-ac0d-e6595e1cd556 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:45.879225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:45.890877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72c502-635b-4c06-b6ad-f4f5c58e2d7d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:45.928523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4a434-5800-4604-8e2c-6b9ee17bbc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:45.929523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4a434-5800-4604-8e2c-6b9ee17bbc4d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:45.929985 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4a434-5800-4604-8e2c-6b9ee17bbc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:45.931761 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4a434-5800-4604-8e2c-6b9ee17bbc4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:45.932871 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4a434-5800-4604-8e2c-6b9ee17bbc4d None admin] RBAC: Adding query filter params (group.id=27a1e7c050ff43b9bcfd1e35fbc6650c, role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7, scope.project.id=d94efb6a61fb468abaff458dda955336) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:45.933389 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4a434-5800-4604-8e2c-6b9ee17bbc4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:45.935035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4a434-5800-4604-8e2c-6b9ee17bbc4d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:45.941893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 227/436] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 11 13:59:45 2022] GET /identity/v3/role_assignments?group.id=27a1e7c050ff43b9bcfd1e35fbc6650c&scope.project.id=d94efb6a61fb468abaff458dda955336&role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:45.966741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14540c-b0e1-4e4a-ac0d-e6595e1cd556 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:46.010446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12404e88-beb1-4832-9995-6bf6c8ab1aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:46.011350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12404e88-beb1-4832-9995-6bf6c8ab1aab None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:46.011638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12404e88-beb1-4832-9995-6bf6c8ab1aab None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:46.011914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12404e88-beb1-4832-9995-6bf6c8ab1aab None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:46.013256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12404e88-beb1-4832-9995-6bf6c8ab1aab None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:46.014780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12404e88-beb1-4832-9995-6bf6c8ab1aab None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:46.016918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 210/437] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:45 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:46.022919 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4a434-5800-4604-8e2c-6b9ee17bbc4d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:46.161387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4a434-5800-4604-8e2c-6b9ee17bbc4d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:46.201096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6193ab-cd26-4419-82fc-4d88d97756f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:46.202369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6193ab-cd26-4419-82fc-4d88d97756f5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:46.202868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6193ab-cd26-4419-82fc-4d88d97756f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:46.203382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6193ab-cd26-4419-82fc-4d88d97756f5 None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:46.204852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6193ab-cd26-4419-82fc-4d88d97756f5 None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:46.206560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6193ab-cd26-4419-82fc-4d88d97756f5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:46.208741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 228/438] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:46 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:46.215208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12404e88-beb1-4832-9995-6bf6c8ab1aab None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:46.241777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:46.334276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12404e88-beb1-4832-9995-6bf6c8ab1aab None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:46.373296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a92a33-d58c-4210-897e-4c26e5c5c1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:46.373973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a92a33-d58c-4210-897e-4c26e5c5c1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:46.374292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a92a33-d58c-4210-897e-4c26e5c5c1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:46.374558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a92a33-d58c-4210-897e-4c26e5c5c1b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:46.375413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a92a33-d58c-4210-897e-4c26e5c5c1b1 None admin] RBAC: Adding query filter params (group.id=27a1e7c050ff43b9bcfd1e35fbc6650c, role.id=8b1dade745704cf3a2a92b5ac07853b4, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:46.375725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a92a33-d58c-4210-897e-4c26e5c5c1b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:46.377183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a92a33-d58c-4210-897e-4c26e5c5c1b1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:46.384317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 211/439] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 11 13:59:46 2022] GET /identity/v3/role_assignments?group.id=27a1e7c050ff43b9bcfd1e35fbc6650c&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=8b1dade745704cf3a2a92b5ac07853b4 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:46.514962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c336-0c59-4f79-a0b3-f76cb5076755 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:46.515296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c336-0c59-4f79-a0b3-f76cb5076755 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:46.515432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1218473-43fa-4401-b78f-efc2df06d5d5 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:46.515514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c336-0c59-4f79-a0b3-f76cb5076755 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:46.515683 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1218473-43fa-4401-b78f-efc2df06d5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:46.515889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1218473-43fa-4401-b78f-efc2df06d5d5 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:46.517022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 229/440] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:46.517490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 212/441] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:46.522899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364bcb9-538f-4d67-8969-319ef8a233a7 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:46.523164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364bcb9-538f-4d67-8969-319ef8a233a7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:46.523323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a237d-a430-4914-ae8f-49157c0dfeb3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:46.523450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364bcb9-538f-4d67-8969-319ef8a233a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:46.523590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a237d-a430-4914-ae8f-49157c0dfeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:46.523954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a237d-a430-4914-ae8f-49157c0dfeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:46.543152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-161a237d-a430-4914-ae8f-49157c0dfeb3 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:46.543343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4364bcb9-538f-4d67-8969-319ef8a233a7 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:46.544366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-161a237d-a430-4914-ae8f-49157c0dfeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:46.544542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4364bcb9-538f-4d67-8969-319ef8a233a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:46.568641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:46.641103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 230/442] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:46.644564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 213/443] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:46.665916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364bcb9-538f-4d67-8969-319ef8a233a7 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:46.670456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a237d-a430-4914-ae8f-49157c0dfeb3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:46.687372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:46.799459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364bcb9-538f-4d67-8969-319ef8a233a7 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:46.802541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a237d-a430-4914-ae8f-49157c0dfeb3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:46.838870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37115889-98df-457d-8633-38326b68a0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:46.839689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37115889-98df-457d-8633-38326b68a0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:46.839973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37115889-98df-457d-8633-38326b68a0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:46.840250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37115889-98df-457d-8633-38326b68a0d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:46.841878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656e246-6532-4776-a1dd-0ef3b1e1f1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:46.842733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656e246-6532-4776-a1dd-0ef3b1e1f1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:46.843016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656e246-6532-4776-a1dd-0ef3b1e1f1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:46.843295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656e246-6532-4776-a1dd-0ef3b1e1f1f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:46.852047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37115889-98df-457d-8633-38326b68a0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:46.855141 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656e246-6532-4776-a1dd-0ef3b1e1f1f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-37115889-98df-457d-8633-38326b68a0d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:46.860109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:46.861073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:46.861869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 231/444] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 13:59:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2656e246-6532-4776-a1dd-0ef3b1e1f1f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:46.863742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:46.864757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:46.865648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 214/445] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:46.867464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37115889-98df-457d-8633-38326b68a0d4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:46.872010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656e246-6532-4776-a1dd-0ef3b1e1f1f7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:46.885455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:46.951926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:46.976071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37115889-98df-457d-8633-38326b68a0d4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:46.977411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656e246-6532-4776-a1dd-0ef3b1e1f1f7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:47.011484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e16cc-3dd6-4790-88f8-95d163f81892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:47.012156 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e16cc-3dd6-4790-88f8-95d163f81892 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:47.012440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e16cc-3dd6-4790-88f8-95d163f81892 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:47.012635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f038ea-9f71-4b03-b9d6-38462b3265bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:47.012742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e16cc-3dd6-4790-88f8-95d163f81892 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:47.013308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f038ea-9f71-4b03-b9d6-38462b3265bb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:47.013456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e16cc-3dd6-4790-88f8-95d163f81892 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:47.013592 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f038ea-9f71-4b03-b9d6-38462b3265bb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:47.013762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e16cc-3dd6-4790-88f8-95d163f81892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:47.013870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f038ea-9f71-4b03-b9d6-38462b3265bb None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:47.014654 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f038ea-9f71-4b03-b9d6-38462b3265bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:47.014960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f038ea-9f71-4b03-b9d6-38462b3265bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:47.015177 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e16cc-3dd6-4790-88f8-95d163f81892 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:47.016324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f038ea-9f71-4b03-b9d6-38462b3265bb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:47.023663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 232/446] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:47.024677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 215/447] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:47.029497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e16cc-3dd6-4790-88f8-95d163f81892 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:47.029896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f038ea-9f71-4b03-b9d6-38462b3265bb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:47.105552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:47.129753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f038ea-9f71-4b03-b9d6-38462b3265bb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:47.132805 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e16cc-3dd6-4790-88f8-95d163f81892 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:47.163909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05961856-8716-4a4c-99c3-49c3b3228bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:47.165108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05961856-8716-4a4c-99c3-49c3b3228bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:47.165431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05961856-8716-4a4c-99c3-49c3b3228bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:47.165706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05961856-8716-4a4c-99c3-49c3b3228bb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:47.167939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b1ed3-dfb6-4882-880c-aeae3df358c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:47.168593 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1ed3-dfb6-4882-880c-aeae3df358c2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:47.168877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1ed3-dfb6-4882-880c-aeae3df358c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:47.169753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:47.169870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b1ed3-dfb6-4882-880c-aeae3df358c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:47.237536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b1ed3-dfb6-4882-880c-aeae3df358c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:47.239033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b1ed3-dfb6-4882-880c-aeae3df358c2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:47.240155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05961856-8716-4a4c-99c3-49c3b3228bb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:47.241637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05961856-8716-4a4c-99c3-49c3b3228bb6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:47.314567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:47.340636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 233/448] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:47.341917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 216/449] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:47.346180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b1ed3-dfb6-4882-880c-aeae3df358c2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:47.347443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05961856-8716-4a4c-99c3-49c3b3228bb6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:47.380730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:47.448651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b1ed3-dfb6-4882-880c-aeae3df358c2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:47.448894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05961856-8716-4a4c-99c3-49c3b3228bb6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:47.483185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5a24b-d3ab-4f36-958c-47523f3da3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:47.484044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5a24b-d3ab-4f36-958c-47523f3da3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:47.484202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f824057-a9d4-4acf-87b3-9cdb69d0ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:47.484311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5a24b-d3ab-4f36-958c-47523f3da3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:47.484583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5a24b-d3ab-4f36-958c-47523f3da3f1 None admin] PATH_INFO: `/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:47.485128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f824057-a9d4-4acf-87b3-9cdb69d0ec68 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:47.485354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f824057-a9d4-4acf-87b3-9cdb69d0ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:47.485679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f824057-a9d4-4acf-87b3-9cdb69d0ec68 None admin] PATH_INFO: `/v3/projects/53f35d51b66c4aec847015cb4a904c77` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:47.485766 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5a24b-d3ab-4f36-958c-47523f3da3f1 None admin] RBAC: Authorizing `identity:get_project(project_id=bf2fd0aef6ed4a1b97eab01228b80cac)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:47.486905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f824057-a9d4-4acf-87b3-9cdb69d0ec68 None admin] RBAC: Authorizing `identity:get_project(project_id=53f35d51b66c4aec847015cb4a904c77)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:47.487212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5a24b-d3ab-4f36-958c-47523f3da3f1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:47.488348 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f824057-a9d4-4acf-87b3-9cdb69d0ec68 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:47.488886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 217/450] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:47 2022] GET /identity/v3/projects/bf2fd0aef6ed4a1b97eab01228b80cac => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:47.490038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 234/451] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 13:59:47 2022] GET /identity/v3/projects/53f35d51b66c4aec847015cb4a904c77 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:47.494470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5a24b-d3ab-4f36-958c-47523f3da3f1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:47.495450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f824057-a9d4-4acf-87b3-9cdb69d0ec68 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:47.538668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:47.595596 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5a24b-d3ab-4f36-958c-47523f3da3f1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:47.597893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:47.607881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f824057-a9d4-4acf-87b3-9cdb69d0ec68 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:47.631761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367d603-8abf-456e-ac03-8171e78cb60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:47.632541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367d603-8abf-456e-ac03-8171e78cb60c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:47.632822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367d603-8abf-456e-ac03-8171e78cb60c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:47.633098 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367d603-8abf-456e-ac03-8171e78cb60c None admin] PATH_INFO: `/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:47.634368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367d603-8abf-456e-ac03-8171e78cb60c None admin] RBAC: Authorizing `identity:get_group(group_id=27a1e7c050ff43b9bcfd1e35fbc6650c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:47.635808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367d603-8abf-456e-ac03-8171e78cb60c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:47.637584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 218/452] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:47 2022] GET /identity/v3/groups/27a1e7c050ff43b9bcfd1e35fbc6650c => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:47.641469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98729a95-5d9b-41dc-bbc7-c00c6796b1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:47.642487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98729a95-5d9b-41dc-bbc7-c00c6796b1eb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:47.642770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98729a95-5d9b-41dc-bbc7-c00c6796b1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:47.643048 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98729a95-5d9b-41dc-bbc7-c00c6796b1eb None admin] PATH_INFO: `/v3/groups/96032242530d4799af7448de0ee947d1` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:47.643140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367d603-8abf-456e-ac03-8171e78cb60c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:47.644214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98729a95-5d9b-41dc-bbc7-c00c6796b1eb None admin] RBAC: Authorizing `identity:get_group(group_id=96032242530d4799af7448de0ee947d1)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:47.645951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98729a95-5d9b-41dc-bbc7-c00c6796b1eb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:47.647634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 235/453] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Jul 11 13:59:47 2022] GET /identity/v3/groups/96032242530d4799af7448de0ee947d1 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:47.654750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98729a95-5d9b-41dc-bbc7-c00c6796b1eb None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:47.747536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367d603-8abf-456e-ac03-8171e78cb60c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:47.754430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98729a95-5d9b-41dc-bbc7-c00c6796b1eb None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:47.765545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:47.782176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab449d5-e7b4-445e-b340-bbab2b6984ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:47.782852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab449d5-e7b4-445e-b340-bbab2b6984ef None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:47.783137 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab449d5-e7b4-445e-b340-bbab2b6984ef None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:47.783418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab449d5-e7b4-445e-b340-bbab2b6984ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:47.784257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab449d5-e7b4-445e-b340-bbab2b6984ef None admin] RBAC: Adding query filter params (group.id=27a1e7c050ff43b9bcfd1e35fbc6650c, role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7, scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:47.784571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab449d5-e7b4-445e-b340-bbab2b6984ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:47.786013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab449d5-e7b4-445e-b340-bbab2b6984ef None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:47.790906 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc805b87-1020-4369-9674-e2410bdf1ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:47.791564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805b87-1020-4369-9674-e2410bdf1ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:47.791892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805b87-1020-4369-9674-e2410bdf1ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:47.792191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 219/454] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 11 13:59:47 2022] GET /identity/v3/role_assignments?group.id=27a1e7c050ff43b9bcfd1e35fbc6650c&scope.project.id=bf2fd0aef6ed4a1b97eab01228b80cac&role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:47.792351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc805b87-1020-4369-9674-e2410bdf1ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:47.793141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc805b87-1020-4369-9674-e2410bdf1ad6 None admin] RBAC: Adding query filter params (group.id=96032242530d4799af7448de0ee947d1, role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=53f35d51b66c4aec847015cb4a904c77) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:47.793434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc805b87-1020-4369-9674-e2410bdf1ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:47.795053 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc805b87-1020-4369-9674-e2410bdf1ad6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:47.804630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 236/455] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Jul 11 13:59:47 2022] GET /identity/v3/role_assignments?group.id=96032242530d4799af7448de0ee947d1&scope.project.id=53f35d51b66c4aec847015cb4a904c77&role.id=57f1335a97b5490cb0853894c2faf62c => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:50.339677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d15d-3171-4eee-8265-6948ab22831b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:50.340185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d15d-3171-4eee-8265-6948ab22831b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:50.340259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58d15d-3171-4eee-8265-6948ab22831b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:50.341751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 220/456] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:50.360324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623bf4f-3bf5-4fc8-a4f0-311d812e3f50 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:50.360827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623bf4f-3bf5-4fc8-a4f0-311d812e3f50 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:50.360902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623bf4f-3bf5-4fc8-a4f0-311d812e3f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:50.382461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-9623bf4f-3bf5-4fc8-a4f0-311d812e3f50 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:50.384317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9623bf4f-3bf5-4fc8-a4f0-311d812e3f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:50.477697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 237/457] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:50.527692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58d15d-3171-4eee-8265-6948ab22831b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:50.587400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:50.689357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58d15d-3171-4eee-8265-6948ab22831b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:50.740676 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47ccac-e131-4d4b-a221-59a48b2f1292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:50.741441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47ccac-e131-4d4b-a221-59a48b2f1292 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:50.741729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47ccac-e131-4d4b-a221-59a48b2f1292 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:50.742011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47ccac-e131-4d4b-a221-59a48b2f1292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:50.757933 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47ccac-e131-4d4b-a221-59a48b2f1292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:50.759550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47ccac-e131-4d4b-a221-59a48b2f1292 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6c47ccac-e131-4d4b-a221-59a48b2f1292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:50.781854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:50.782791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:50.783637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:50.783637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:50.783637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:50.783637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:50.787544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 221/458] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:50.792475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5992-a11e-4da4-bb15-b7084bb9941b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:50.793141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5992-a11e-4da4-bb15-b7084bb9941b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:50.793672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e5992-a11e-4da4-bb15-b7084bb9941b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:50.793995 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47ccac-e131-4d4b-a221-59a48b2f1292 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:50.795752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 238/459] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:50.801541 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e3bc-eb71-492f-918a-0e5b31c111b6 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:50.801834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e3bc-eb71-492f-918a-0e5b31c111b6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:50.802122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8e3bc-eb71-492f-918a-0e5b31c111b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:50.827985 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-bdf8e3bc-eb71-492f-918a-0e5b31c111b6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:50.829180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-bdf8e3bc-eb71-492f-918a-0e5b31c111b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:50.956280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:50.960073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 239/460] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:50.962208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75493e3d-8821-41a0-8244-9325fa86480d None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:50.962801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75493e3d-8821-41a0-8244-9325fa86480d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:50.963714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75493e3d-8821-41a0-8244-9325fa86480d None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:50.969415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 240/461] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:50.970799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47ccac-e131-4d4b-a221-59a48b2f1292 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:50.971185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f92a6-e325-4cf1-89f5-48afa36be1ba None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:50.971642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f92a6-e325-4cf1-89f5-48afa36be1ba None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:50.972064 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f92a6-e325-4cf1-89f5-48afa36be1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:50.998797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ac3f92a6-e325-4cf1-89f5-48afa36be1ba None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:51.000498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ac3f92a6-e325-4cf1-89f5-48afa36be1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:51.009082 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee789a0-b666-4060-809b-de202efa455e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:51.009765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee789a0-b666-4060-809b-de202efa455e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:51.010055 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee789a0-b666-4060-809b-de202efa455e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:51.010824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee789a0-b666-4060-809b-de202efa455e None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:51.011134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee789a0-b666-4060-809b-de202efa455e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:51.011450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee789a0-b666-4060-809b-de202efa455e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:51.012912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee789a0-b666-4060-809b-de202efa455e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:51.030949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 222/462] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 13:59:51.031967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee789a0-b666-4060-809b-de202efa455e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:51.035748 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:51.084029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 241/463] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:51.085138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f92a6-e325-4cf1-89f5-48afa36be1ba None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:51.141151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee789a0-b666-4060-809b-de202efa455e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:51.175756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e3f74-ddce-41ae-b1a9-50111c079d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:51.176658 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e3f74-ddce-41ae-b1a9-50111c079d2a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:51.176947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e3f74-ddce-41ae-b1a9-50111c079d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:51.177224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e3f74-ddce-41ae-b1a9-50111c079d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:51.190176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e3f74-ddce-41ae-b1a9-50111c079d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:51.191649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e3f74-ddce-41ae-b1a9-50111c079d2a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:51.199864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f92a6-e325-4cf1-89f5-48afa36be1ba None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:51.203815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-565e3f74-ddce-41ae-b1a9-50111c079d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:51.215979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:51.216848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:51.217696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:51.217696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:51.217696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:51.217696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:51.219920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 223/464] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:51.221017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4aec-13bc-4cb8-8b1a-178436edf9be None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:51.221306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4aec-13bc-4cb8-8b1a-178436edf9be None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:51.221581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4aec-13bc-4cb8-8b1a-178436edf9be None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:51.223024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 224/465] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:51.223552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e4aec-13bc-4cb8-8b1a-178436edf9be None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:51.245105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9ee1d-eb14-47ea-b720-c40502ac992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:51.245882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9ee1d-eb14-47ea-b720-c40502ac992f None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:51.246194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9ee1d-eb14-47ea-b720-c40502ac992f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:51.246485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9ee1d-eb14-47ea-b720-c40502ac992f None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:51.247203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9ee1d-eb14-47ea-b720-c40502ac992f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:51.248664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9ee1d-eb14-47ea-b720-c40502ac992f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:51.282469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 242/466] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:59:51 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:51.284160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3e2c2-e077-4ee1-9a6a-6cba2fe29964 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:51.284457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3e2c2-e077-4ee1-9a6a-6cba2fe29964 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:51.284741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3e2c2-e077-4ee1-9a6a-6cba2fe29964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:51.309173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-39a3e2c2-e077-4ee1-9a6a-6cba2fe29964 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:51.310808 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-39a3e2c2-e077-4ee1-9a6a-6cba2fe29964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:51.332218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:51.351607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e4aec-13bc-4cb8-8b1a-178436edf9be None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:51.409201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74422-f8e8-4da0-afa5-6231e686af2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:51.409201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74422-f8e8-4da0-afa5-6231e686af2e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:51.409201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74422-f8e8-4da0-afa5-6231e686af2e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:51.409201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74422-f8e8-4da0-afa5-6231e686af2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:51.410235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 243/467] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:51.411787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3e2c2-e077-4ee1-9a6a-6cba2fe29964 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:51.417381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74422-f8e8-4da0-afa5-6231e686af2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:51.421742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74422-f8e8-4da0-afa5-6231e686af2e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d0e74422-f8e8-4da0-afa5-6231e686af2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:51.441965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:51.442922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:51.443785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:51.443785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:51.443785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:51.443785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:51.445534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 225/468] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:51.451277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74422-f8e8-4da0-afa5-6231e686af2e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:51.515935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:51.552461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3e2c2-e077-4ee1-9a6a-6cba2fe29964 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:51.574665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74422-f8e8-4da0-afa5-6231e686af2e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:51.595709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4193716-40c2-4c7a-8638-78f27944dc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:51.596393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193716-40c2-4c7a-8638-78f27944dc24 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:51.596681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193716-40c2-4c7a-8638-78f27944dc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:51.596966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4193716-40c2-4c7a-8638-78f27944dc24 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:51.597708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4193716-40c2-4c7a-8638-78f27944dc24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:51.598021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4193716-40c2-4c7a-8638-78f27944dc24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:51.599444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4193716-40c2-4c7a-8638-78f27944dc24 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:51.619475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 244/469] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:51.620421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4193716-40c2-4c7a-8638-78f27944dc24 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:51.630249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f800d1-125f-49de-9e8b-763de79d6fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:51.630935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f800d1-125f-49de-9e8b-763de79d6fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:51.631221 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f800d1-125f-49de-9e8b-763de79d6fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:51.631509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f800d1-125f-49de-9e8b-763de79d6fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:51.632783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f800d1-125f-49de-9e8b-763de79d6fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:51.633095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f800d1-125f-49de-9e8b-763de79d6fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:51.635153 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f800d1-125f-49de-9e8b-763de79d6fd2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:51.636471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:51.654519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 226/470] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:51.656017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f800d1-125f-49de-9e8b-763de79d6fd2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:51.736616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4193716-40c2-4c7a-8638-78f27944dc24 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:51.776917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577040b6-e6f0-42f4-a50e-59faea857d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:51.777842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577040b6-e6f0-42f4-a50e-59faea857d5e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:51.778218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577040b6-e6f0-42f4-a50e-59faea857d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:51.778577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577040b6-e6f0-42f4-a50e-59faea857d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:51.790096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577040b6-e6f0-42f4-a50e-59faea857d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:51.792220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577040b6-e6f0-42f4-a50e-59faea857d5e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:51.796600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f800d1-125f-49de-9e8b-763de79d6fd2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-577040b6-e6f0-42f4-a50e-59faea857d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:51.812791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:51.813710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:51.814606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:51.814606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:51.814606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:51.814606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:51.814824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:51.814895 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 245/471] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:51.815561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577040b6-e6f0-42f4-a50e-59faea857d5e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:51.844783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c569a-9bb7-4597-9ebe-cfc124c1c629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:51.845462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c569a-9bb7-4597-9ebe-cfc124c1c629 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:51.845746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c569a-9bb7-4597-9ebe-cfc124c1c629 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:51.846020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c569a-9bb7-4597-9ebe-cfc124c1c629 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:51.846780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c569a-9bb7-4597-9ebe-cfc124c1c629 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:51.848219 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c569a-9bb7-4597-9ebe-cfc124c1c629 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:51.869692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 227/472] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:59:51 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:51.870695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c569a-9bb7-4597-9ebe-cfc124c1c629 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:51.907738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:51.982926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577040b6-e6f0-42f4-a50e-59faea857d5e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:52.022500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c569a-9bb7-4597-9ebe-cfc124c1c629 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:52.022733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea302f5-3a94-45be-aed8-0c89d3729aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:52.023461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea302f5-3a94-45be-aed8-0c89d3729aed None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:52.023749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea302f5-3a94-45be-aed8-0c89d3729aed None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:52.024695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea302f5-3a94-45be-aed8-0c89d3729aed None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:52.025664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea302f5-3a94-45be-aed8-0c89d3729aed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:52.027389 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea302f5-3a94-45be-aed8-0c89d3729aed None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:52.056992 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 246/473] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:59:51 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:52.059438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a796ea-0e22-494c-8516-353981d570f3 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:52.059728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a796ea-0e22-494c-8516-353981d570f3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:52.060010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a796ea-0e22-494c-8516-353981d570f3 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:52.062322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 247/474] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:52.068476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d697d3-0b60-4e6b-b8a7-e90171057676 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:52.068725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d697d3-0b60-4e6b-b8a7-e90171057676 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:52.068959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d697d3-0b60-4e6b-b8a7-e90171057676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:52.076070 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9236177-6647-4710-8160-f436c7e9d609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:52.077968 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9236177-6647-4710-8160-f436c7e9d609 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:52.078292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9236177-6647-4710-8160-f436c7e9d609 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:52.078579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9236177-6647-4710-8160-f436c7e9d609 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:52.079455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9236177-6647-4710-8160-f436c7e9d609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:52.079771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9236177-6647-4710-8160-f436c7e9d609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:52.081202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9236177-6647-4710-8160-f436c7e9d609 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:52.089931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a7d697d3-0b60-4e6b-b8a7-e90171057676 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:52.091237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a7d697d3-0b60-4e6b-b8a7-e90171057676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:52.098744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 228/475] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:52.105020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9236177-6647-4710-8160-f436c7e9d609 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:52.154559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:52.189190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 248/476] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:52.215508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d697d3-0b60-4e6b-b8a7-e90171057676 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:52.259919 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9236177-6647-4710-8160-f436c7e9d609 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:52.285536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:52.306145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84207f1d-0053-4151-af0b-82b1cd9b727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:52.306893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84207f1d-0053-4151-af0b-82b1cd9b727e None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:52.307182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84207f1d-0053-4151-af0b-82b1cd9b727e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:52.307462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84207f1d-0053-4151-af0b-82b1cd9b727e None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:52.308200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84207f1d-0053-4151-af0b-82b1cd9b727e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:52.310331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84207f1d-0053-4151-af0b-82b1cd9b727e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:52.340156 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 229/477] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:59:52 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:52.359311 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d697d3-0b60-4e6b-b8a7-e90171057676 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:52.400509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19327d-3d4d-4b7c-bb09-e4a7135b9f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:52.401495 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19327d-3d4d-4b7c-bb09-e4a7135b9f2b None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:52.401950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19327d-3d4d-4b7c-bb09-e4a7135b9f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:52.402397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19327d-3d4d-4b7c-bb09-e4a7135b9f2b None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:52.403402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19327d-3d4d-4b7c-bb09-e4a7135b9f2b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:52.405041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19327d-3d4d-4b7c-bb09-e4a7135b9f2b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:52.413294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.sql.core [None req-3d19327d-3d4d-4b7c-bb09-e4a7135b9f2b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 13:59:52.413294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 13:59:52.413294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [parameters: {'id': '6636cf76f68948b4a06b3973d09212ba', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 13:59:52.413294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80387) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-3d19327d-3d4d-4b7c-bb09-e4a7135b9f2b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application conn.query(q) Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result.read() Jul 11 13:59:52.432680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return ref.to_dict() Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 13:59:52.433794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application next(self.gen) Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application yield resource Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application next(self.gen) Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise self.value Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application session.commit() Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 13:59:52.434965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.session.flush() Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application compat.raise_( Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 13:59:52.436013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 13:59:52.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application conn.query(q) Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result.read() Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 13:59:52.438077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [parameters: {'id': '6636cf76f68948b4a06b3973d09212ba', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:52.439112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 11 13:59:52.440003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:52.442787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 249/478] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Jul 11 13:59:52 2022] POST /identity/v3/roles => generated 144 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:52.449506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84207f1d-0053-4151-af0b-82b1cd9b727e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:52.556463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:52.576926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84207f1d-0053-4151-af0b-82b1cd9b727e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:52.613328 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0bdb8-4637-4276-9535-7c09a3199794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:52.614060 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0bdb8-4637-4276-9535-7c09a3199794 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:52.614373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0bdb8-4637-4276-9535-7c09a3199794 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:52.614649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0bdb8-4637-4276-9535-7c09a3199794 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:52.626318 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0bdb8-4637-4276-9535-7c09a3199794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-ddc0bdb8-4637-4276-9535-7c09a3199794 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:52.634819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:52.635743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:52.636531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 230/479] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 13:59:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:52.643375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19327d-3d4d-4b7c-bb09-e4a7135b9f2b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:52.767442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19327d-3d4d-4b7c-bb09-e4a7135b9f2b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:52.781712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:52.808625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a408d5-c8e9-42f6-9ed0-049b28c60957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:52.809315 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a408d5-c8e9-42f6-9ed0-049b28c60957 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:52.809602 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a408d5-c8e9-42f6-9ed0-049b28c60957 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:52.809884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a408d5-c8e9-42f6-9ed0-049b28c60957 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:52.810687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a408d5-c8e9-42f6-9ed0-049b28c60957 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:52.811001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a408d5-c8e9-42f6-9ed0-049b28c60957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:52.812390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a408d5-c8e9-42f6-9ed0-049b28c60957 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:52.823127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 250/480] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:53.907542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4544de-9989-4e85-81fc-8b4a29e297bd None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:53.908087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4544de-9989-4e85-81fc-8b4a29e297bd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:53.908087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4544de-9989-4e85-81fc-8b4a29e297bd None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:53.909748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 231/481] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:53.915244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cbc17-39ff-4ca6-94be-89759ac9dfc3 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:53.915685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cbc17-39ff-4ca6-94be-89759ac9dfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:53.915863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cbc17-39ff-4ca6-94be-89759ac9dfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:53.943165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-326cbc17-39ff-4ca6-94be-89759ac9dfc3 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:53.944374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-326cbc17-39ff-4ca6-94be-89759ac9dfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:54.039246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 251/482] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:54.087859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4544de-9989-4e85-81fc-8b4a29e297bd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:54.204303 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4544de-9989-4e85-81fc-8b4a29e297bd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:54.240291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75fce0-b6e4-41f9-8281-dd3a74197b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:54.241094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75fce0-b6e4-41f9-8281-dd3a74197b86 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:54.241376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75fce0-b6e4-41f9-8281-dd3a74197b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:54.241653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75fce0-b6e4-41f9-8281-dd3a74197b86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:54.252430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75fce0-b6e4-41f9-8281-dd3a74197b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6b75fce0-b6e4-41f9-8281-dd3a74197b86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:54.260198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:54.261069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:54.262331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 232/483] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 13:59:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:54.267897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cbc17-39ff-4ca6-94be-89759ac9dfc3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:54.393343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cbc17-39ff-4ca6-94be-89759ac9dfc3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:54.395999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:54.431241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493eaba-461f-4424-81c1-a964c5ffc83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:54.431921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493eaba-461f-4424-81c1-a964c5ffc83b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:54.432208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493eaba-461f-4424-81c1-a964c5ffc83b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:54.432488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493eaba-461f-4424-81c1-a964c5ffc83b None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:54.433245 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493eaba-461f-4424-81c1-a964c5ffc83b None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:54.433556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493eaba-461f-4424-81c1-a964c5ffc83b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:54.434973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493eaba-461f-4424-81c1-a964c5ffc83b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:54.443627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 252/484] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 13:59:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:54.449986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75fce0-b6e4-41f9-8281-dd3a74197b86 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:54.453987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:54.557830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75fce0-b6e4-41f9-8281-dd3a74197b86 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:54.593530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b0d09-2d0d-4dfc-85e9-ac5779d73bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:54.594389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b0d09-2d0d-4dfc-85e9-ac5779d73bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:54.594675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b0d09-2d0d-4dfc-85e9-ac5779d73bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:54.594951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b0d09-2d0d-4dfc-85e9-ac5779d73bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:54.607481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b0d09-2d0d-4dfc-85e9-ac5779d73bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:54.609025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b0d09-2d0d-4dfc-85e9-ac5779d73bf4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:54.626593 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853d688-3b9e-4d65-a66d-b063fe1feb18 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:54.626940 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853d688-3b9e-4d65-a66d-b063fe1feb18 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:54.627167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853d688-3b9e-4d65-a66d-b063fe1feb18 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:54.628551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 253/485] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8e8b0d09-2d0d-4dfc-85e9-ac5779d73bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:54.633202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:54.634208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:54.635054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:54.635054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:54.635054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:54.635054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:54.635054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 233/486] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:54.640419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853d688-3b9e-4d65-a66d-b063fe1feb18 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:54.647834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403b2ed-59f6-47ae-9c3c-273f09ca5e60 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:54.648130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403b2ed-59f6-47ae-9c3c-273f09ca5e60 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:54.648414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403b2ed-59f6-47ae-9c3c-273f09ca5e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:54.677829 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-2403b2ed-59f6-47ae-9c3c-273f09ca5e60 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:54.679103 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2403b2ed-59f6-47ae-9c3c-273f09ca5e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:54.783665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:54.812605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 234/487] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:54.825091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d74d-cd2e-42ab-a97b-aae9b862fb36 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:54.825390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d74d-cd2e-42ab-a97b-aae9b862fb36 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:54.825699 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d74d-cd2e-42ab-a97b-aae9b862fb36 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:54.827554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 235/488] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 13:59:54.838178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69ba91-67b4-4f32-8f3a-9884b6b23796 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:54.838178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69ba91-67b4-4f32-8f3a-9884b6b23796 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:54.838178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69ba91-67b4-4f32-8f3a-9884b6b23796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:54.839239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853d688-3b9e-4d65-a66d-b063fe1feb18 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:54.856658 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-be69ba91-67b4-4f32-8f3a-9884b6b23796 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:54.858004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-be69ba91-67b4-4f32-8f3a-9884b6b23796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:54.876673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b577d6-0662-4ae2-a3e6-1fd3e22723a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:54.877824 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b577d6-0662-4ae2-a3e6-1fd3e22723a9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:54.878378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b577d6-0662-4ae2-a3e6-1fd3e22723a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:54.878756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b577d6-0662-4ae2-a3e6-1fd3e22723a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:54.879606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b577d6-0662-4ae2-a3e6-1fd3e22723a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:54.880012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b577d6-0662-4ae2-a3e6-1fd3e22723a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:54.881510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b577d6-0662-4ae2-a3e6-1fd3e22723a9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:54.898573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 254/489] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:54.900718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b577d6-0662-4ae2-a3e6-1fd3e22723a9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:54.929492 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:54.950180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 236/490] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 13:59:54.950180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69ba91-67b4-4f32-8f3a-9884b6b23796 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:55.038874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b577d6-0662-4ae2-a3e6-1fd3e22723a9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:55.078050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4bb02-5301-4062-9e27-d1c605990709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:55.078947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69ba91-67b4-4f32-8f3a-9884b6b23796 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:55.079446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4bb02-5301-4062-9e27-d1c605990709 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.079946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4bb02-5301-4062-9e27-d1c605990709 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.080537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4bb02-5301-4062-9e27-d1c605990709 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.092236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4bb02-5301-4062-9e27-d1c605990709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:55.098135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-bac4bb02-5301-4062-9e27-d1c605990709 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:55.102629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:55.103665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:59:55.104453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:55.108198 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 255/491] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 13:59:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:55.109451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4bb02-5301-4062-9e27-d1c605990709 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:55.122934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0dd4b2-02c3-4b71-b020-05b88557a56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:55.123746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dd4b2-02c3-4b71-b020-05b88557a56d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.124027 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dd4b2-02c3-4b71-b020-05b88557a56d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.124310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dd4b2-02c3-4b71-b020-05b88557a56d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.135322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0dd4b2-02c3-4b71-b020-05b88557a56d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:55.137394 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0dd4b2-02c3-4b71-b020-05b88557a56d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-be0dd4b2-02c3-4b71-b020-05b88557a56d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:59:55.160531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:55.161520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:55.162448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:55.162448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:55.162448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:59:55.162448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:59:55.162448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:59:55.162448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:59:55.162448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:59:55.162448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:59:55.162448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 13:59:55.162448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:55.166244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 237/492] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 11 13:59:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:55.167879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0dd4b2-02c3-4b71-b020-05b88557a56d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:55.219663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:55.237694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4bb02-5301-4062-9e27-d1c605990709 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:55.274310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e800c7-caa8-44f0-8c43-c57c4b515d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:55.275414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e800c7-caa8-44f0-8c43-c57c4b515d60 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.275914 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e800c7-caa8-44f0-8c43-c57c4b515d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.276361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e800c7-caa8-44f0-8c43-c57c4b515d60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.277859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0dd4b2-02c3-4b71-b020-05b88557a56d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:55.287700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e800c7-caa8-44f0-8c43-c57c4b515d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-13e800c7-caa8-44f0-8c43-c57c4b515d60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:55.299095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:55.300077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:59:55.300897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:55.301523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 256/493] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 13:59:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:55.302680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e800c7-caa8-44f0-8c43-c57c4b515d60 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:55.320672 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d3bd8-4948-4bcd-9ff5-3be4166d2389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:55.321629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3bd8-4948-4bcd-9ff5-3be4166d2389 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.322015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3bd8-4948-4bcd-9ff5-3be4166d2389 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.322349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3bd8-4948-4bcd-9ff5-3be4166d2389 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.323104 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3bd8-4948-4bcd-9ff5-3be4166d2389 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:55.323412 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3bd8-4948-4bcd-9ff5-3be4166d2389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:55.324799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3bd8-4948-4bcd-9ff5-3be4166d2389 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:55.333132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 238/494] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 13:59:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:55.334459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb92b-0bc5-4ef9-973c-db098819bfba None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.334704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb92b-0bc5-4ef9-973c-db098819bfba None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.334983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb92b-0bc5-4ef9-973c-db098819bfba None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.340722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 239/495] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:55.340722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb92b-0bc5-4ef9-973c-db098819bfba None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:55.388477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:55.419990 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e800c7-caa8-44f0-8c43-c57c4b515d60 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:55.455295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a8a08-fecc-4d45-b171-aff01e7ab0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:55.455974 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a8a08-fecc-4d45-b171-aff01e7ab0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.456239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb92b-0bc5-4ef9-973c-db098819bfba None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:55.456354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a8a08-fecc-4d45-b171-aff01e7ab0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.456527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a8a08-fecc-4d45-b171-aff01e7ab0b3 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.457380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a8a08-fecc-4d45-b171-aff01e7ab0b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:55.457695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a8a08-fecc-4d45-b171-aff01e7ab0b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:55.459195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a8a08-fecc-4d45-b171-aff01e7ab0b3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:55.497006 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c71633-e64e-40dd-905a-2135a460eef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:55.497967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c71633-e64e-40dd-905a-2135a460eef3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.498414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c71633-e64e-40dd-905a-2135a460eef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.498809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c71633-e64e-40dd-905a-2135a460eef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.499768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c71633-e64e-40dd-905a-2135a460eef3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:55.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 257/496] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 11 13:59:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:55.500563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c71633-e64e-40dd-905a-2135a460eef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:55.502427 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c71633-e64e-40dd-905a-2135a460eef3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:55.505338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a8a08-fecc-4d45-b171-aff01e7ab0b3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:55.509232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:55.512971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 240/497] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 13:59:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:55.514545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3cf57-5986-49f8-9ebd-80728560ad64 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.515009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3cf57-5986-49f8-9ebd-80728560ad64 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.515460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3cf57-5986-49f8-9ebd-80728560ad64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.533361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-2cc3cf57-5986-49f8-9ebd-80728560ad64 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:55.534598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2cc3cf57-5986-49f8-9ebd-80728560ad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:55.609402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 241/498] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:55.610197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3cf57-5986-49f8-9ebd-80728560ad64 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:55.631487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a8a08-fecc-4d45-b171-aff01e7ab0b3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:55.648326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:55.669826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85b222-82a1-4c6b-b30e-ef412925cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:55.670664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85b222-82a1-4c6b-b30e-ef412925cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.670952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85b222-82a1-4c6b-b30e-ef412925cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.671224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85b222-82a1-4c6b-b30e-ef412925cbc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.681863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85b222-82a1-4c6b-b30e-ef412925cbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:55.683381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a85b222-82a1-4c6b-b30e-ef412925cbc5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-7a85b222-82a1-4c6b-b30e-ef412925cbc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:55.701019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:55.702037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:55.702978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:55.702978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:55.702978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:55.702978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:55.702978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 258/499] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:55.703253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85b222-82a1-4c6b-b30e-ef412925cbc5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:55.725694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3cf57-5986-49f8-9ebd-80728560ad64 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:55.759867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2290a-77a2-41da-a0f0-b93e245b3c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:55.760054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:55.760523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2290a-77a2-41da-a0f0-b93e245b3c1e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.760853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2290a-77a2-41da-a0f0-b93e245b3c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.761284 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2290a-77a2-41da-a0f0-b93e245b3c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.809081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85b222-82a1-4c6b-b30e-ef412925cbc5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:55.830542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2290a-77a2-41da-a0f0-b93e245b3c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:55.832002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2290a-77a2-41da-a0f0-b93e245b3c1e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:55.842045 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797fea-a180-4585-8793-1a3a55fe97c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:55.842866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797fea-a180-4585-8793-1a3a55fe97c7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.843170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797fea-a180-4585-8793-1a3a55fe97c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.843427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797fea-a180-4585-8793-1a3a55fe97c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.854564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4797fea-a180-4585-8793-1a3a55fe97c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:55.856028 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4797fea-a180-4585-8793-1a3a55fe97c7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:55.862117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-e4797fea-a180-4585-8793-1a3a55fe97c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:55.873566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:55.874497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:55.875351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:55.875351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:55.875351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:55.875351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:55.875351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 259/500] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:55.875613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797fea-a180-4585-8793-1a3a55fe97c7 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:55.935540 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 242/501] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:55.937054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3149-31a6-42ca-b887-f00217060a60 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:55.937346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3149-31a6-42ca-b887-f00217060a60 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:55.937620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3149-31a6-42ca-b887-f00217060a60 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:55.939484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 243/502] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 13:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 13:59:55.939640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff3149-31a6-42ca-b887-f00217060a60 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:55.989862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797fea-a180-4585-8793-1a3a55fe97c7 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.000140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:56.027931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f25400-512f-4457-a25f-65c5bed49c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.029050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f25400-512f-4457-a25f-65c5bed49c51 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.029341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f25400-512f-4457-a25f-65c5bed49c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.029620 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f25400-512f-4457-a25f-65c5bed49c51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.040802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f25400-512f-4457-a25f-65c5bed49c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-e9f25400-512f-4457-a25f-65c5bed49c51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 13:59:56.048607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:56.049511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:56.050358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 260/503] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 13:59:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:56.051037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f25400-512f-4457-a25f-65c5bed49c51 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:56.055279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff3149-31a6-42ca-b887-f00217060a60 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.085192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:56.092040 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a36fe2-bea5-4d7b-a160-5c09b8ba5b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.092714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a36fe2-bea5-4d7b-a160-5c09b8ba5b09 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.092996 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a36fe2-bea5-4d7b-a160-5c09b8ba5b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.093275 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a36fe2-bea5-4d7b-a160-5c09b8ba5b09 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.094006 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a36fe2-bea5-4d7b-a160-5c09b8ba5b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:56.094343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a36fe2-bea5-4d7b-a160-5c09b8ba5b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:56.095828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a36fe2-bea5-4d7b-a160-5c09b8ba5b09 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:56.107680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 244/504] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:56.108509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a36fe2-bea5-4d7b-a160-5c09b8ba5b09 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:56.158041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f25400-512f-4457-a25f-65c5bed49c51 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.191963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221992a-32f4-49b6-b845-66758268d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.192633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221992a-32f4-49b6-b845-66758268d46c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.192923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221992a-32f4-49b6-b845-66758268d46c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.193206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221992a-32f4-49b6-b845-66758268d46c None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.193945 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221992a-32f4-49b6-b845-66758268d46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:56.194289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221992a-32f4-49b6-b845-66758268d46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:56.196213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221992a-32f4-49b6-b845-66758268d46c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:56.208648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 261/505] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:56.212451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a32861-739f-479c-a497-bdbfa8daa00c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.212451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a32861-739f-479c-a497-bdbfa8daa00c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.212451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a32861-739f-479c-a497-bdbfa8daa00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.220912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a36fe2-bea5-4d7b-a160-5c09b8ba5b09 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.227152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-19a32861-739f-479c-a497-bdbfa8daa00c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 13:59:56.228347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-19a32861-739f-479c-a497-bdbfa8daa00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 13:59:56.250880 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:56.254986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632505a-dca9-4fda-8905-3461d88fef45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.255777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632505a-dca9-4fda-8905-3461d88fef45 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.256063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632505a-dca9-4fda-8905-3461d88fef45 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.256338 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632505a-dca9-4fda-8905-3461d88fef45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.267308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632505a-dca9-4fda-8905-3461d88fef45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:56.268797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632505a-dca9-4fda-8905-3461d88fef45 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1632505a-dca9-4fda-8905-3461d88fef45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:56.286827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:56.287769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:56.288622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:56.288622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:56.288622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:56.288622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:56.288622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 245/506] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:56.288882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632505a-dca9-4fda-8905-3461d88fef45 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:56.297920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 262/507] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 13:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 13:59:56.298895 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a32861-739f-479c-a497-bdbfa8daa00c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:56.334390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:56.393201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632505a-dca9-4fda-8905-3461d88fef45 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.409200 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a32861-739f-479c-a497-bdbfa8daa00c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.428436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9824170-8628-44c7-b7b7-eda1d756e57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.429104 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824170-8628-44c7-b7b7-eda1d756e57a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.429394 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824170-8628-44c7-b7b7-eda1d756e57a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.429668 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824170-8628-44c7-b7b7-eda1d756e57a None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.431555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9824170-8628-44c7-b7b7-eda1d756e57a None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:56.431879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9824170-8628-44c7-b7b7-eda1d756e57a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:56.433806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9824170-8628-44c7-b7b7-eda1d756e57a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:56.441839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 246/508] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 13:59:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:56.442847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9824170-8628-44c7-b7b7-eda1d756e57a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:56.456458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f002c-5022-4b14-b043-d6a2b15a1647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.457270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f002c-5022-4b14-b043-d6a2b15a1647 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.457558 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f002c-5022-4b14-b043-d6a2b15a1647 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.457832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f002c-5022-4b14-b043-d6a2b15a1647 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.465776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f002c-5022-4b14-b043-d6a2b15a1647 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:56.467274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f002c-5022-4b14-b043-d6a2b15a1647 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8e0f002c-5022-4b14-b043-d6a2b15a1647 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:59:56.484077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:56.485886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 263/509] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:56.487699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f002c-5022-4b14-b043-d6a2b15a1647 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:56.508589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:56.560584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9824170-8628-44c7-b7b7-eda1d756e57a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.563424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:56.597408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054bfd-f29a-4b79-bb03-8770e2fe648f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.597904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f002c-5022-4b14-b043-d6a2b15a1647 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.598298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054bfd-f29a-4b79-bb03-8770e2fe648f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.598641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054bfd-f29a-4b79-bb03-8770e2fe648f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.598940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054bfd-f29a-4b79-bb03-8770e2fe648f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.607117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa054bfd-f29a-4b79-bb03-8770e2fe648f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:56.608560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa054bfd-f29a-4b79-bb03-8770e2fe648f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-fa054bfd-f29a-4b79-bb03-8770e2fe648f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:59:56.623231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:56.624293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 247/510] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 13:59:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:56.625395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054bfd-f29a-4b79-bb03-8770e2fe648f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:56.637684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfab47e-6405-4d69-a86a-5617a10fb1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.638392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfab47e-6405-4d69-a86a-5617a10fb1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.638684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfab47e-6405-4d69-a86a-5617a10fb1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.638966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfab47e-6405-4d69-a86a-5617a10fb1d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.639716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfab47e-6405-4d69-a86a-5617a10fb1d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:56.640016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfab47e-6405-4d69-a86a-5617a10fb1d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:56.641407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfab47e-6405-4d69-a86a-5617a10fb1d9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:56.653995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 264/511] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:56.654925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfab47e-6405-4d69-a86a-5617a10fb1d9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:56.732045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054bfd-f29a-4b79-bb03-8770e2fe648f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.738325 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:56.761356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfab47e-6405-4d69-a86a-5617a10fb1d9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.766534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdcf39-7e85-4cca-a1b6-c6262f6f509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.767358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdcf39-7e85-4cca-a1b6-c6262f6f509c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.767642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdcf39-7e85-4cca-a1b6-c6262f6f509c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.767917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdcf39-7e85-4cca-a1b6-c6262f6f509c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.779036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdcf39-7e85-4cca-a1b6-c6262f6f509c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:56.780512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdcf39-7e85-4cca-a1b6-c6262f6f509c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:56.796009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16ddae-7bfb-4a87-b1f9-8ee8b050fb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.796835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16ddae-7bfb-4a87-b1f9-8ee8b050fb6a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.797205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16ddae-7bfb-4a87-b1f9-8ee8b050fb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.797535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16ddae-7bfb-4a87-b1f9-8ee8b050fb6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-89fdcf39-7e85-4cca-a1b6-c6262f6f509c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:56.798656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:56.799663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:56.800579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:56.800579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:56.800579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:56.800579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:56.800579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 248/512] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:56.800842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdcf39-7e85-4cca-a1b6-c6262f6f509c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:56.810579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16ddae-7bfb-4a87-b1f9-8ee8b050fb6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:56.812058 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16ddae-7bfb-4a87-b1f9-8ee8b050fb6a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:56.820171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-ba16ddae-7bfb-4a87-b1f9-8ee8b050fb6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:56.830287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:56.831313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:56.837703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:56.837703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:56.837703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:56.837703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:56.837703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 265/513] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:56.837703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16ddae-7bfb-4a87-b1f9-8ee8b050fb6a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:56.904881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdcf39-7e85-4cca-a1b6-c6262f6f509c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.938116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249f99e-fa70-470f-bdce-1799b5d5645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.938815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f99e-fa70-470f-bdce-1799b5d5645b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.939096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f99e-fa70-470f-bdce-1799b5d5645b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.939372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249f99e-fa70-470f-bdce-1799b5d5645b None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.940219 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249f99e-fa70-470f-bdce-1799b5d5645b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:56.940525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249f99e-fa70-470f-bdce-1799b5d5645b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:56.941971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249f99e-fa70-470f-bdce-1799b5d5645b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:56.942219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16ddae-7bfb-4a87-b1f9-8ee8b050fb6a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:56.975651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:56.980901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 249/514] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 11 13:59:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:56.981769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249f99e-fa70-470f-bdce-1799b5d5645b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:56.987013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b6a1d-7f87-4413-a50b-dfcebd1622e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:56.987641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b6a1d-7f87-4413-a50b-dfcebd1622e5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:56.987955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b6a1d-7f87-4413-a50b-dfcebd1622e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:56.988239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b6a1d-7f87-4413-a50b-dfcebd1622e5 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:56.989110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b6a1d-7f87-4413-a50b-dfcebd1622e5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:56.989419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b6a1d-7f87-4413-a50b-dfcebd1622e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:56.990902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b6a1d-7f87-4413-a50b-dfcebd1622e5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:57.011040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 266/515] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 11 13:59:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:57.011884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b6a1d-7f87-4413-a50b-dfcebd1622e5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:57.062688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:57.090091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249f99e-fa70-470f-bdce-1799b5d5645b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:57.112715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b6a1d-7f87-4413-a50b-dfcebd1622e5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:57.124478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0e972-c8be-42a0-a34e-7566f4a24927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:57.125271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0e972-c8be-42a0-a34e-7566f4a24927 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:57.125555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0e972-c8be-42a0-a34e-7566f4a24927 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:57.125841 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0e972-c8be-42a0-a34e-7566f4a24927 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:57.132690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0e972-c8be-42a0-a34e-7566f4a24927 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:57.134841 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0e972-c8be-42a0-a34e-7566f4a24927 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:57.147232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f33629-64be-4857-87f3-bb71046be3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:57.147899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f33629-64be-4857-87f3-bb71046be3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:57.148184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f33629-64be-4857-87f3-bb71046be3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:57.148460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f33629-64be-4857-87f3-bb71046be3b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:57.149397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f33629-64be-4857-87f3-bb71046be3b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:57.149710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f33629-64be-4857-87f3-bb71046be3b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d0c0e972-c8be-42a0-a34e-7566f4a24927 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:59:57.150398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:57.151248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:57.152097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:59:57.152097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:59:57.152097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:59:57.152097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:59:57.152097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:59:57.152097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:59:57.152097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:57.152097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:57.152524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f33629-64be-4857-87f3-bb71046be3b9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:57.152595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 250/516] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:57.152595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0e972-c8be-42a0-a34e-7566f4a24927 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:57.167637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 267/517] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:57.167637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f33629-64be-4857-87f3-bb71046be3b9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:57.215829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:57.269229 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0e972-c8be-42a0-a34e-7566f4a24927 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:57.273899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f33629-64be-4857-87f3-bb71046be3b9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:57.306659 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95122cb7-a65d-497e-a0a5-afdc5bd52d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:57.307348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95122cb7-a65d-497e-a0a5-afdc5bd52d20 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:57.307676 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95122cb7-a65d-497e-a0a5-afdc5bd52d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:57.307985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95122cb7-a65d-497e-a0a5-afdc5bd52d20 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:57.308712 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95122cb7-a65d-497e-a0a5-afdc5bd52d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:57.308974 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c1836-1945-4a8e-9011-4630e30bf825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:57.309091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95122cb7-a65d-497e-a0a5-afdc5bd52d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:57.309659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1836-1945-4a8e-9011-4630e30bf825 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:57.309992 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1836-1945-4a8e-9011-4630e30bf825 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:57.310309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c1836-1945-4a8e-9011-4630e30bf825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:57.310542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95122cb7-a65d-497e-a0a5-afdc5bd52d20 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:57.312052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:57.324422 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 251/518] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:57.325248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95122cb7-a65d-497e-a0a5-afdc5bd52d20 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:57.387952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c1836-1945-4a8e-9011-4630e30bf825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:57.389591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c1836-1945-4a8e-9011-4630e30bf825 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:57.426788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95122cb7-a65d-497e-a0a5-afdc5bd52d20 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:57.437372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:57.461469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ead4a-343b-4a3d-b9a5-5a83d3a24945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:57.462116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ead4a-343b-4a3d-b9a5-5a83d3a24945 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:57.462427 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ead4a-343b-4a3d-b9a5-5a83d3a24945 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:57.462701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ead4a-343b-4a3d-b9a5-5a83d3a24945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:57.490983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 268/519] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:57.491831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c1836-1945-4a8e-9011-4630e30bf825 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:57.526944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:57.534820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ead4a-343b-4a3d-b9a5-5a83d3a24945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:57.536314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ead4a-343b-4a3d-b9a5-5a83d3a24945 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:57.596179 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c1836-1945-4a8e-9011-4630e30bf825 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:57.631967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e5b9c-df48-4f67-b2df-dc20f932379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:57.632629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5b9c-df48-4f67-b2df-dc20f932379b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:57.632982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5b9c-df48-4f67-b2df-dc20f932379b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:57.633477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e5b9c-df48-4f67-b2df-dc20f932379b None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:57.634483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e5b9c-df48-4f67-b2df-dc20f932379b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:57.634715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 252/520] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:57.634807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e5b9c-df48-4f67-b2df-dc20f932379b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:57.635535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ead4a-343b-4a3d-b9a5-5a83d3a24945 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:57.636250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e5b9c-df48-4f67-b2df-dc20f932379b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:57.655903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 269/521] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 13:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:57.656736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e5b9c-df48-4f67-b2df-dc20f932379b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:57.667550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:57.733575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:57.741527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ead4a-343b-4a3d-b9a5-5a83d3a24945 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:57.758522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e5b9c-df48-4f67-b2df-dc20f932379b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:57.776623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd77f70-a7f0-485c-9486-92fef2226a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:57.777364 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77f70-a7f0-485c-9486-92fef2226a6f None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:57.777597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77f70-a7f0-485c-9486-92fef2226a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:57.777879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd77f70-a7f0-485c-9486-92fef2226a6f None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:57.778649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd77f70-a7f0-485c-9486-92fef2226a6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:57.780091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd77f70-a7f0-485c-9486-92fef2226a6f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:57.793790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14885c0-7e9f-4409-8d46-fcd1dd432973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:57.795147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14885c0-7e9f-4409-8d46-fcd1dd432973 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:57.795466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14885c0-7e9f-4409-8d46-fcd1dd432973 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:57.795963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14885c0-7e9f-4409-8d46-fcd1dd432973 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:57.800775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 253/522] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 13:59:57 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 13:59:57.801595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd77f70-a7f0-485c-9486-92fef2226a6f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:57.806473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14885c0-7e9f-4409-8d46-fcd1dd432973 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:57.807987 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14885c0-7e9f-4409-8d46-fcd1dd432973 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d14885c0-7e9f-4409-8d46-fcd1dd432973 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 13:59:57.824676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:57.825858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:57.827105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:57.827105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:57.827105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 13:59:57.827105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 13:59:57.827105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 13:59:57.827105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 13:59:57.827105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 13:59:57.827105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 13:59:57.827105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 13:59:57.827105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:57.830681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 270/523] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 13:59:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:57.831836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14885c0-7e9f-4409-8d46-fcd1dd432973 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:57.924270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:57.933597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd77f70-a7f0-485c-9486-92fef2226a6f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:57.966897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14885c0-7e9f-4409-8d46-fcd1dd432973 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:57.972966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5b7cf-74fe-4cab-83d6-7ad4d766f6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:57.973841 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5b7cf-74fe-4cab-83d6-7ad4d766f6be None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:57.974124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5b7cf-74fe-4cab-83d6-7ad4d766f6be None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:57.974427 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5b7cf-74fe-4cab-83d6-7ad4d766f6be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:57.986268 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5b7cf-74fe-4cab-83d6-7ad4d766f6be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:57.987795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5b7cf-74fe-4cab-83d6-7ad4d766f6be None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:58.008823 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937daafd-3f5b-49da-95d3-65781db4ec77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3ce5b7cf-74fe-4cab-83d6-7ad4d766f6be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:58.009443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:58.010456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:58.011413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:58.011413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:58.011413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:58.011413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:58.011631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937daafd-3f5b-49da-95d3-65781db4ec77 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:58.011631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937daafd-3f5b-49da-95d3-65781db4ec77 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:58.011631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937daafd-3f5b-49da-95d3-65781db4ec77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:58.014238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 254/524] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:58.015311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5b7cf-74fe-4cab-83d6-7ad4d766f6be None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:58.019106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:58.025289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937daafd-3f5b-49da-95d3-65781db4ec77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:58.026842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937daafd-3f5b-49da-95d3-65781db4ec77 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-937daafd-3f5b-49da-95d3-65781db4ec77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:58.046381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:58.047349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:58.048999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:58.048999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:58.048999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:58.048999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:58.048999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 271/525] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:58.048999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937daafd-3f5b-49da-95d3-65781db4ec77 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:58.135496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5b7cf-74fe-4cab-83d6-7ad4d766f6be None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:58.163117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937daafd-3f5b-49da-95d3-65781db4ec77 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:58.179826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213ba8f-9618-458c-acce-88b4307db4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:58.180505 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ba8f-9618-458c-acce-88b4307db4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:58.180954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ba8f-9618-458c-acce-88b4307db4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:58.181235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a213ba8f-9618-458c-acce-88b4307db4c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:58.182149 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213ba8f-9618-458c-acce-88b4307db4c4 None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=38a31386700941c9b103720a64bac405) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:58.182490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213ba8f-9618-458c-acce-88b4307db4c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:58.183946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a213ba8f-9618-458c-acce-88b4307db4c4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:58.187216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:58.194204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 255/526] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:58 2022] GET /identity/v3/role_assignments?user.id=38a31386700941c9b103720a64bac405&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:58.194204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213ba8f-9618-458c-acce-88b4307db4c4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:58.228167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3269-5fab-4ffc-a92c-09768efbae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:58.229269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3269-5fab-4ffc-a92c-09768efbae62 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:58.229787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3269-5fab-4ffc-a92c-09768efbae62 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:58.230311 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3269-5fab-4ffc-a92c-09768efbae62 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:58.231427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b3269-5fab-4ffc-a92c-09768efbae62 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:58.232027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b3269-5fab-4ffc-a92c-09768efbae62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:58.233821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b3269-5fab-4ffc-a92c-09768efbae62 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:58.255354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 272/527] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Jul 11 13:59:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:58.256621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3269-5fab-4ffc-a92c-09768efbae62 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:58.282377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:58.323706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a213ba8f-9618-458c-acce-88b4307db4c4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:58.362677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa9266-1a44-46d0-921b-682c6b4d94c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:58.363469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa9266-1a44-46d0-921b-682c6b4d94c5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:58.363647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa9266-1a44-46d0-921b-682c6b4d94c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:58.363914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa9266-1a44-46d0-921b-682c6b4d94c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:58.364653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa9266-1a44-46d0-921b-682c6b4d94c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:58.364963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa9266-1a44-46d0-921b-682c6b4d94c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:58.366416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa9266-1a44-46d0-921b-682c6b4d94c5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:58.384934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 256/528] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:58.384934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa9266-1a44-46d0-921b-682c6b4d94c5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:58.385199 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3269-5fab-4ffc-a92c-09768efbae62 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:58.426458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207b3d-f8d5-49ce-87de-e4deda196424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:58.427218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207b3d-f8d5-49ce-87de-e4deda196424 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:58.427575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207b3d-f8d5-49ce-87de-e4deda196424 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:58.427971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207b3d-f8d5-49ce-87de-e4deda196424 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:58.428847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207b3d-f8d5-49ce-87de-e4deda196424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:58.429272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207b3d-f8d5-49ce-87de-e4deda196424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:58.431620 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207b3d-f8d5-49ce-87de-e4deda196424 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:58.448935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 273/529] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:58.449882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207b3d-f8d5-49ce-87de-e4deda196424 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:58.499077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:58.511020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa9266-1a44-46d0-921b-682c6b4d94c5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:58.544898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:58.557132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e206e-0d71-4e01-8b1a-d074f35f4c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:58.558183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e206e-0d71-4e01-8b1a-d074f35f4c8b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:58.558705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e206e-0d71-4e01-8b1a-d074f35f4c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:58.559175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e206e-0d71-4e01-8b1a-d074f35f4c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:58.585337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207b3d-f8d5-49ce-87de-e4deda196424 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:58.628140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc82dbc-1b55-4983-95ad-28d2aac88c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:58.629484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc82dbc-1b55-4983-95ad-28d2aac88c16 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:58.630023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc82dbc-1b55-4983-95ad-28d2aac88c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:58.630524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc82dbc-1b55-4983-95ad-28d2aac88c16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:58.638717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc82dbc-1b55-4983-95ad-28d2aac88c16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:58.639831 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e206e-0d71-4e01-8b1a-d074f35f4c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:58.640768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc82dbc-1b55-4983-95ad-28d2aac88c16 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:58.641322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e206e-0d71-4e01-8b1a-d074f35f4c8b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-6bc82dbc-1b55-4983-95ad-28d2aac88c16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:59:58.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:58.659173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:58.660005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:59:58.660005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:59:58.660005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:59:58.660005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:59:58.660005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:59:58.660005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:59:58.660005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:58.660005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:58.662575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 274/530] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:58.663701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc82dbc-1b55-4983-95ad-28d2aac88c16 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:58.770462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 257/531] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 13:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 13:59:58.770462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e206e-0d71-4e01-8b1a-d074f35f4c8b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:58.775931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc82dbc-1b55-4983-95ad-28d2aac88c16 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:58.777963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:58.802364 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:58.827547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab478c-ccd8-4bae-82fb-f7f0e035559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:58.828355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab478c-ccd8-4bae-82fb-f7f0e035559a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:58.828651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab478c-ccd8-4bae-82fb-f7f0e035559a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:58.829301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab478c-ccd8-4bae-82fb-f7f0e035559a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:58.839592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab478c-ccd8-4bae-82fb-f7f0e035559a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:58.841987 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab478c-ccd8-4bae-82fb-f7f0e035559a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d1ab478c-ccd8-4bae-82fb-f7f0e035559a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:59:58.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:58.861721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:58.862597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:59:58.862597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:59:58.862597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:59:58.862597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:59:58.862597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:59:58.862597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:59:58.862597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:58.862597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:58.866310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 275/532] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:58.867885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab478c-ccd8-4bae-82fb-f7f0e035559a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:58.895593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e206e-0d71-4e01-8b1a-d074f35f4c8b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:58.938080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73fa4d-0ebc-407c-8521-f0d060c7e718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:58.939318 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73fa4d-0ebc-407c-8521-f0d060c7e718 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:58.939754 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73fa4d-0ebc-407c-8521-f0d060c7e718 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:58.940442 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73fa4d-0ebc-407c-8521-f0d060c7e718 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:58.941791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73fa4d-0ebc-407c-8521-f0d060c7e718 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:58.942289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73fa4d-0ebc-407c-8521-f0d060c7e718 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:58.943917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73fa4d-0ebc-407c-8521-f0d060c7e718 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:58.971867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 258/533] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 13:59:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:58.973724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73fa4d-0ebc-407c-8521-f0d060c7e718 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:59.000034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab478c-ccd8-4bae-82fb-f7f0e035559a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:59.037342 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4e4f3-fb0f-4c19-81d0-12a7c9fa539d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:59.038372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e4f3-fb0f-4c19-81d0-12a7c9fa539d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:59.038754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e4f3-fb0f-4c19-81d0-12a7c9fa539d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:59.039150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e4f3-fb0f-4c19-81d0-12a7c9fa539d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:59.052488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4e4f3-fb0f-4c19-81d0-12a7c9fa539d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:59.054218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4e4f3-fb0f-4c19-81d0-12a7c9fa539d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-2cd4e4f3-fb0f-4c19-81d0-12a7c9fa539d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 13:59:59.074037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:59.075135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:59.076232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 13:59:59.076232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 13:59:59.076232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 13:59:59.076232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 13:59:59.082130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 276/534] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 13:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 13:59:59.083212 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4e4f3-fb0f-4c19-81d0-12a7c9fa539d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:59.089168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:59.099981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:59.112998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73fa4d-0ebc-407c-8521-f0d060c7e718 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:59.165476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8a7ba-625d-4a14-90e2-2892b8ac9f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:59.166915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8a7ba-625d-4a14-90e2-2892b8ac9f7f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:59.167198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8a7ba-625d-4a14-90e2-2892b8ac9f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:59.167475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8a7ba-625d-4a14-90e2-2892b8ac9f7f None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:59.168263 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8a7ba-625d-4a14-90e2-2892b8ac9f7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:59.168570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8a7ba-625d-4a14-90e2-2892b8ac9f7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:59.170010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8a7ba-625d-4a14-90e2-2892b8ac9f7f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:59.189474 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 259/535] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 13:59:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:59.189474 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8a7ba-625d-4a14-90e2-2892b8ac9f7f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:59.224896 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4e4f3-fb0f-4c19-81d0-12a7c9fa539d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:59.263082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0167e-76d5-4e51-99f8-4435700cfe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:59.263743 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0167e-76d5-4e51-99f8-4435700cfe4c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:59.264087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0167e-76d5-4e51-99f8-4435700cfe4c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:59.264370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0167e-76d5-4e51-99f8-4435700cfe4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:59.265217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0167e-76d5-4e51-99f8-4435700cfe4c None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=690a93a4d6ed4666a607b05a8c2b6549) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:59.265530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0167e-76d5-4e51-99f8-4435700cfe4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:59.267139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0167e-76d5-4e51-99f8-4435700cfe4c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:59.273822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 277/536] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:59 2022] GET /identity/v3/role_assignments?user.id=690a93a4d6ed4666a607b05a8c2b6549&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:59.275047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0167e-76d5-4e51-99f8-4435700cfe4c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:59.339903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8a7ba-625d-4a14-90e2-2892b8ac9f7f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:59.431069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:59.433842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ce3a6-a095-4d00-b9b7-9f23823b68c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:59.434679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ce3a6-a095-4d00-b9b7-9f23823b68c9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:59.434966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ce3a6-a095-4d00-b9b7-9f23823b68c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:59.435311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ce3a6-a095-4d00-b9b7-9f23823b68c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:59.436992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ce3a6-a095-4d00-b9b7-9f23823b68c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:59.437301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ce3a6-a095-4d00-b9b7-9f23823b68c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:59.438758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31ce3a6-a095-4d00-b9b7-9f23823b68c9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:59.456135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 260/537] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 13:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:59.473580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ce3a6-a095-4d00-b9b7-9f23823b68c9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:59.486919 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0167e-76d5-4e51-99f8-4435700cfe4c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:59.489700 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:59.522318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d380b2-97f0-4b4f-a032-8a2bea25f3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:59.523319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d380b2-97f0-4b4f-a032-8a2bea25f3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:59.524423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d380b2-97f0-4b4f-a032-8a2bea25f3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:59.525048 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d380b2-97f0-4b4f-a032-8a2bea25f3a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:59.526210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d380b2-97f0-4b4f-a032-8a2bea25f3a6 None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=a5cf559c8a69483ca7625f37d5931439) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:59.527097 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d380b2-97f0-4b4f-a032-8a2bea25f3a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:59.529930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d380b2-97f0-4b4f-a032-8a2bea25f3a6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:59.538078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 278/538] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:59 2022] GET /identity/v3/role_assignments?user.id=a5cf559c8a69483ca7625f37d5931439&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:59.624854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ce3a6-a095-4d00-b9b7-9f23823b68c9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:59.673401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7a490-076e-49e0-b3e1-0ce3535fafb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:59.674583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7a490-076e-49e0-b3e1-0ce3535fafb4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:59.675045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7a490-076e-49e0-b3e1-0ce3535fafb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:59.675492 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7a490-076e-49e0-b3e1-0ce3535fafb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:59.688162 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7a490-076e-49e0-b3e1-0ce3535fafb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:59.689929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7a490-076e-49e0-b3e1-0ce3535fafb4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-93c7a490-076e-49e0-b3e1-0ce3535fafb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 13:59:59.708363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 13:59:59.709292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 13:59:59.710147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 13:59:59.710147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 13:59:59.710147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 13:59:59.710147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 13:59:59.710147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 13:59:59.710147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 13:59:59.710147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 13:59:59.710147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 13:59:59.713281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 261/539] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 13:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 13:59:59.719375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d380b2-97f0-4b4f-a032-8a2bea25f3a6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:59.832965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d380b2-97f0-4b4f-a032-8a2bea25f3a6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 13:59:59.873675 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ffc47-22b0-4730-b33e-ff738caed782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 13:59:59.874665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ffc47-22b0-4730-b33e-ff738caed782 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 13:59:59.875115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ffc47-22b0-4730-b33e-ff738caed782 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 13:59:59.875534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ffc47-22b0-4730-b33e-ff738caed782 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 13:59:59.876493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ffc47-22b0-4730-b33e-ff738caed782 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 13:59:59.876952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ffc47-22b0-4730-b33e-ff738caed782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 13:59:59.878586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ffc47-22b0-4730-b33e-ff738caed782 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 13:59:59.887728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 13:59:59.896225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 279/540] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 13:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 13:59:59.903169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7a490-076e-49e0-b3e1-0ce3535fafb4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 13:59:59.983552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:00.023191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7a490-076e-49e0-b3e1-0ce3535fafb4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:00.065835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d2fff-a358-4cad-8d58-4a04b67f3265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:00.066925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d2fff-a358-4cad-8d58-4a04b67f3265 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:00.067364 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d2fff-a358-4cad-8d58-4a04b67f3265 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:00.067781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d2fff-a358-4cad-8d58-4a04b67f3265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:00.068827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d2fff-a358-4cad-8d58-4a04b67f3265 None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=4426582f945e4c90bf8debd2ecbd9769) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:00.069282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d2fff-a358-4cad-8d58-4a04b67f3265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:00.071455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d2fff-a358-4cad-8d58-4a04b67f3265 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:00.078050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 262/541] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 13:59:59 2022] GET /identity/v3/role_assignments?user.id=4426582f945e4c90bf8debd2ecbd9769&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:00.085340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51aeef-d236-465c-ba99-2089b6087aaa None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:00.085833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51aeef-d236-465c-ba99-2089b6087aaa None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:00.085913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51aeef-d236-465c-ba99-2089b6087aaa None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:00.090293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 280/542] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:00.094350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdc4e4-9924-4154-b5f0-b495cedd30e4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:00.094646 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdc4e4-9924-4154-b5f0-b495cedd30e4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:00.094934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdc4e4-9924-4154-b5f0-b495cedd30e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:00.113155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c4bdc4e4-9924-4154-b5f0-b495cedd30e4 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:00.114445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c4bdc4e4-9924-4154-b5f0-b495cedd30e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:00.240977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 263/543] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:00.277974 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51aeef-d236-465c-ba99-2089b6087aaa None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:00.395578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51aeef-d236-465c-ba99-2089b6087aaa None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:00.442754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b08bb-1a9b-4120-b360-684c717453c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:00.443579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b08bb-1a9b-4120-b360-684c717453c6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:00.443863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b08bb-1a9b-4120-b360-684c717453c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:00.444139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b08bb-1a9b-4120-b360-684c717453c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:00.461649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b08bb-1a9b-4120-b360-684c717453c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-1e4b08bb-1a9b-4120-b360-684c717453c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:00.469663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:00.470556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:00.471350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 281/544] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:00.476992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdc4e4-9924-4154-b5f0-b495cedd30e4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:00.549485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:00.599087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdc4e4-9924-4154-b5f0-b495cedd30e4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:00.647182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e122c54-cb77-45a6-92c9-0176c65b9c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:00.647864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e122c54-cb77-45a6-92c9-0176c65b9c23 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:00.648154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e122c54-cb77-45a6-92c9-0176c65b9c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:00.648428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e122c54-cb77-45a6-92c9-0176c65b9c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:00.649306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e122c54-cb77-45a6-92c9-0176c65b9c23 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:00.649612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e122c54-cb77-45a6-92c9-0176c65b9c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:00.651031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e122c54-cb77-45a6-92c9-0176c65b9c23 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:00.667496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 264/545] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:00.674566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b08bb-1a9b-4120-b360-684c717453c6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:00.757433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:00.806197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b08bb-1a9b-4120-b360-684c717453c6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:00.830986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c01c-6277-446e-b5c6-796781169f17 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:00.831300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c01c-6277-446e-b5c6-796781169f17 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:00.831553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c01c-6277-446e-b5c6-796781169f17 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:00.833305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 265/546] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:00.840984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9141415-82de-44dc-9a4d-36662424fe87 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:00.841320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9141415-82de-44dc-9a4d-36662424fe87 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:00.841609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9141415-82de-44dc-9a4d-36662424fe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:00.849654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77281b4a-ae41-4cdd-ae85-a06124b842da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:00.850509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77281b4a-ae41-4cdd-ae85-a06124b842da None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:00.850805 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77281b4a-ae41-4cdd-ae85-a06124b842da None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:00.851201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77281b4a-ae41-4cdd-ae85-a06124b842da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:00.864856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f9141415-82de-44dc-9a4d-36662424fe87 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:00.866418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f9141415-82de-44dc-9a4d-36662424fe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:00.875983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77281b4a-ae41-4cdd-ae85-a06124b842da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:00.877480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77281b4a-ae41-4cdd-ae85-a06124b842da None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-77281b4a-ae41-4cdd-ae85-a06124b842da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:00.910490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:00.911408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:00.912252 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:00.912252 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:00.912252 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:00.912252 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:00.912980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 282/547] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:00.919301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77281b4a-ae41-4cdd-ae85-a06124b842da None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:00.988153 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 266/548] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:00:01.026789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9141415-82de-44dc-9a4d-36662424fe87 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:01.091152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77281b4a-ae41-4cdd-ae85-a06124b842da None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:01.107680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:01.121899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:01.147175 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66846b2-f756-4dfc-94b4-01d4682465ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:01.148343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66846b2-f756-4dfc-94b4-01d4682465ef None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:01.150587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66846b2-f756-4dfc-94b4-01d4682465ef None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:01.150880 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66846b2-f756-4dfc-94b4-01d4682465ef None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:01.151657 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66846b2-f756-4dfc-94b4-01d4682465ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:01.151971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66846b2-f756-4dfc-94b4-01d4682465ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:01.153361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66846b2-f756-4dfc-94b4-01d4682465ef None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:01.167248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 283/549] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:01.175135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66846b2-f756-4dfc-94b4-01d4682465ef None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:01.202130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9141415-82de-44dc-9a4d-36662424fe87 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:01.240723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1448d-2c9c-4d05-b79c-88c2e5c9ca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:01.241812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1448d-2c9c-4d05-b79c-88c2e5c9ca3f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:01.242803 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1448d-2c9c-4d05-b79c-88c2e5c9ca3f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:01.243257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1448d-2c9c-4d05-b79c-88c2e5c9ca3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:01.254555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1448d-2c9c-4d05-b79c-88c2e5c9ca3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7dc1448d-2c9c-4d05-b79c-88c2e5c9ca3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:01.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:01.264926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:01.265982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:01.268773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 267/550] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:01.276765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1448d-2c9c-4d05-b79c-88c2e5c9ca3f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:01.365457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66846b2-f756-4dfc-94b4-01d4682465ef None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:01.443672 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1448d-2c9c-4d05-b79c-88c2e5c9ca3f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:01.453923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f6299-46ce-4e83-aa1f-fd11cf246acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:01.454836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f6299-46ce-4e83-aa1f-fd11cf246acc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:01.455129 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f6299-46ce-4e83-aa1f-fd11cf246acc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:01.455436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f6299-46ce-4e83-aa1f-fd11cf246acc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:01.459622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:01.475484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f6299-46ce-4e83-aa1f-fd11cf246acc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:01.476900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f6299-46ce-4e83-aa1f-fd11cf246acc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:01.485033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160134-23d3-4b41-853d-45b96d5d1d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:01.486009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160134-23d3-4b41-853d-45b96d5d1d45 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:01.486522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160134-23d3-4b41-853d-45b96d5d1d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:01.487111 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160134-23d3-4b41-853d-45b96d5d1d45 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:01.488128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160134-23d3-4b41-853d-45b96d5d1d45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:01.488652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160134-23d3-4b41-853d-45b96d5d1d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:01.490348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160134-23d3-4b41-853d-45b96d5d1d45 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:01.499750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 268/551] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-387f6299-46ce-4e83-aa1f-fd11cf246acc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:01.504047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:01.505029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:01.506085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:01.506085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:01.506085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:01.506085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:01.506085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:01.506085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:01.506085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:01.506085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:01.506085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:01.506085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:01.508535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160134-23d3-4b41-853d-45b96d5d1d45 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:01.510107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 284/552] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:01.519202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f6299-46ce-4e83-aa1f-fd11cf246acc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:01.583534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:01.708943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f6299-46ce-4e83-aa1f-fd11cf246acc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:01.712784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160134-23d3-4b41-853d-45b96d5d1d45 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:01.775450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963116d-d2f7-48c2-ab50-46d362e3273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:01.776135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963116d-d2f7-48c2-ab50-46d362e3273b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:01.776423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963116d-d2f7-48c2-ab50-46d362e3273b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:01.776707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963116d-d2f7-48c2-ab50-46d362e3273b None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:01.777575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963116d-d2f7-48c2-ab50-46d362e3273b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:01.777887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963116d-d2f7-48c2-ab50-46d362e3273b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:01.779380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963116d-d2f7-48c2-ab50-46d362e3273b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:01.784017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c75cc-fe31-4074-a33a-55bd92741e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:01.784819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c75cc-fe31-4074-a33a-55bd92741e06 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:01.785098 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c75cc-fe31-4074-a33a-55bd92741e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:01.785372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c75cc-fe31-4074-a33a-55bd92741e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:01.808632 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c75cc-fe31-4074-a33a-55bd92741e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:01.810107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c75cc-fe31-4074-a33a-55bd92741e06 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:01.830189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 285/553] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Jul 11 14:00:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:01.830189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51ad88-6c85-4ea9-b434-abb2a54e3785 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:01.830189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51ad88-6c85-4ea9-b434-abb2a54e3785 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:01.830189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51ad88-6c85-4ea9-b434-abb2a54e3785 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:01.830189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 286/554] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:01.830189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51ad88-6c85-4ea9-b434-abb2a54e3785 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-081c75cc-fe31-4074-a33a-55bd92741e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:01.843127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:01.844114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:01.845003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:01.845003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:01.845003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:01.845003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:01.845003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 269/555] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:01.845888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63ab3-1f5a-4e5b-be0c-b2efbbf7b8f0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:01.846200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63ab3-1f5a-4e5b-be0c-b2efbbf7b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:01.846487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b63ab3-1f5a-4e5b-be0c-b2efbbf7b8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:01.871143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b4b63ab3-1f5a-4e5b-be0c-b2efbbf7b8f0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:01.872344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b4b63ab3-1f5a-4e5b-be0c-b2efbbf7b8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:01.896526 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:01.951899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 270/556] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:01.953108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b63ab3-1f5a-4e5b-be0c-b2efbbf7b8f0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:01.958929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:01.967075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51ad88-6c85-4ea9-b434-abb2a54e3785 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:02.013595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba712075-492f-4ccb-8fd7-261a2573889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:02.014673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba712075-492f-4ccb-8fd7-261a2573889c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.015034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba712075-492f-4ccb-8fd7-261a2573889c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.015389 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba712075-492f-4ccb-8fd7-261a2573889c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.058723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b63ab3-1f5a-4e5b-be0c-b2efbbf7b8f0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:02.096367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba712075-492f-4ccb-8fd7-261a2573889c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:02.098067 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba712075-492f-4ccb-8fd7-261a2573889c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:02.099531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52422185-d6b4-45c0-8d43-fdb8ab5a1560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:02.100206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52422185-d6b4-45c0-8d43-fdb8ab5a1560 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.100491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52422185-d6b4-45c0-8d43-fdb8ab5a1560 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.100767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52422185-d6b4-45c0-8d43-fdb8ab5a1560 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.102045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52422185-d6b4-45c0-8d43-fdb8ab5a1560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:02.102488 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52422185-d6b4-45c0-8d43-fdb8ab5a1560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:02.104101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52422185-d6b4-45c0-8d43-fdb8ab5a1560 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:02.122546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 271/557] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:02.123506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52422185-d6b4-45c0-8d43-fdb8ab5a1560 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:02.143624 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:02.193170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:02.212470 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 287/558] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:00:02.213426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326a2f4-f131-4f46-b6ca-5bf66219f088 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.213723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326a2f4-f131-4f46-b6ca-5bf66219f088 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.214004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326a2f4-f131-4f46-b6ca-5bf66219f088 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.215601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 288/559] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:02.216355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326a2f4-f131-4f46-b6ca-5bf66219f088 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:02.252398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52422185-d6b4-45c0-8d43-fdb8ab5a1560 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:02.290810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f419f73-2c4f-41c3-8de5-75bec1aeb536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:02.291503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f419f73-2c4f-41c3-8de5-75bec1aeb536 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.291785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f419f73-2c4f-41c3-8de5-75bec1aeb536 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.292306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f419f73-2c4f-41c3-8de5-75bec1aeb536 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.302974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f419f73-2c4f-41c3-8de5-75bec1aeb536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4f419f73-2c4f-41c3-8de5-75bec1aeb536 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:02.311358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:02.312310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:02.313145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 272/560] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:02.313839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f419f73-2c4f-41c3-8de5-75bec1aeb536 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:02.338387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326a2f4-f131-4f46-b6ca-5bf66219f088 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:02.376011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29210c-8569-4548-9f17-d0be0aa79666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:02.376735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29210c-8569-4548-9f17-d0be0aa79666 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.377026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29210c-8569-4548-9f17-d0be0aa79666 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.377308 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29210c-8569-4548-9f17-d0be0aa79666 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.385033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29210c-8569-4548-9f17-d0be0aa79666 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:02.386521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29210c-8569-4548-9f17-d0be0aa79666 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-ff29210c-8569-4548-9f17-d0be0aa79666 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:02.402120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:02.403385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:02.404321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:02.404321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:02.404321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:02.404321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:02.404321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:02.404321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:02.404321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:02.404321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:02.404321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:02.404321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:02.404321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 289/561] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 11 14:00:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:02.404990 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933808-fae2-4419-aa6b-09879768a034 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.405269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933808-fae2-4419-aa6b-09879768a034 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.405551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933808-fae2-4419-aa6b-09879768a034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.408431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:02.423723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-71933808-fae2-4419-aa6b-09879768a034 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:02.424935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-71933808-fae2-4419-aa6b-09879768a034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:02.434050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f419f73-2c4f-41c3-8de5-75bec1aeb536 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:02.471405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:02.476513 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523cc7-f2e1-49f8-adcb-0e006994950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:02.477899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523cc7-f2e1-49f8-adcb-0e006994950f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.478368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523cc7-f2e1-49f8-adcb-0e006994950f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.478657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523cc7-f2e1-49f8-adcb-0e006994950f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.489999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523cc7-f2e1-49f8-adcb-0e006994950f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:02.491487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523cc7-f2e1-49f8-adcb-0e006994950f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:02.500759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 290/562] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:02.507128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71933808-fae2-4419-aa6b-09879768a034 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-07523cc7-f2e1-49f8-adcb-0e006994950f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:02.511366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:02.512552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:02.513642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:02.513642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:02.513642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:02.513642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:02.514983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 273/563] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:02.515917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523cc7-f2e1-49f8-adcb-0e006994950f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:02.621838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71933808-fae2-4419-aa6b-09879768a034 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:02.624302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523cc7-f2e1-49f8-adcb-0e006994950f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:02.651914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:02.656494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c4f3f-9db7-44a8-9e60-937da021fb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:02.657174 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c4f3f-9db7-44a8-9e60-937da021fb5b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.657463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c4f3f-9db7-44a8-9e60-937da021fb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.657741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c4f3f-9db7-44a8-9e60-937da021fb5b None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.658533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c4f3f-9db7-44a8-9e60-937da021fb5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:02.658897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c4f3f-9db7-44a8-9e60-937da021fb5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:02.660238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c4f3f-9db7-44a8-9e60-937da021fb5b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:02.660758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c153835-18e9-4854-b5fe-a2242a00a664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:02.661428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c153835-18e9-4854-b5fe-a2242a00a664 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.661715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c153835-18e9-4854-b5fe-a2242a00a664 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.661995 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c153835-18e9-4854-b5fe-a2242a00a664 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.662882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c153835-18e9-4854-b5fe-a2242a00a664 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:02.663188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c153835-18e9-4854-b5fe-a2242a00a664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:02.664736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c153835-18e9-4854-b5fe-a2242a00a664 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:02.668678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 291/564] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:02.669488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c4f3f-9db7-44a8-9e60-937da021fb5b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:02.686061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 274/565] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 11 14:00:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:02.686061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c153835-18e9-4854-b5fe-a2242a00a664 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:02.714237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:02.772828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c4f3f-9db7-44a8-9e60-937da021fb5b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:02.788450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c153835-18e9-4854-b5fe-a2242a00a664 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:02.810653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d37560-c960-4165-ab76-03f028cbd1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:02.811351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d37560-c960-4165-ab76-03f028cbd1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.811641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d37560-c960-4165-ab76-03f028cbd1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.811923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d37560-c960-4165-ab76-03f028cbd1d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.812693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d37560-c960-4165-ab76-03f028cbd1d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:02.813014 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d37560-c960-4165-ab76-03f028cbd1d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:02.814430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d37560-c960-4165-ab76-03f028cbd1d4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:02.824416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dc96e-1d57-476b-9d2d-e690fe6021c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:02.825198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dc96e-1d57-476b-9d2d-e690fe6021c5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.825474 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dc96e-1d57-476b-9d2d-e690fe6021c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.825742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dc96e-1d57-476b-9d2d-e690fe6021c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.827798 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 292/566] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:02.829226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30609615-0a21-438a-9d92-692bc9b51060 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.829518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30609615-0a21-438a-9d92-692bc9b51060 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.829796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30609615-0a21-438a-9d92-692bc9b51060 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.831635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 293/567] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:02.832348 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30609615-0a21-438a-9d92-692bc9b51060 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:02.839979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90dc96e-1d57-476b-9d2d-e690fe6021c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d90dc96e-1d57-476b-9d2d-e690fe6021c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:02.847772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:02.848768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:02.849623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 275/568] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:02.850340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dc96e-1d57-476b-9d2d-e690fe6021c5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:02.901584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:02.939281 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:02.943783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30609615-0a21-438a-9d92-692bc9b51060 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:02.956570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90dc96e-1d57-476b-9d2d-e690fe6021c5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:02.978652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b23a5c-4ded-4324-8abd-5862986acedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:02.979435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b23a5c-4ded-4324-8abd-5862986acedc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.979728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b23a5c-4ded-4324-8abd-5862986acedc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.980010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b23a5c-4ded-4324-8abd-5862986acedc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:02.990465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b23a5c-4ded-4324-8abd-5862986acedc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:02.991343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89d4ed-ebb2-41e8-ac65-2e6d90108c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:02.991943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b23a5c-4ded-4324-8abd-5862986acedc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:02.992382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89d4ed-ebb2-41e8-ac65-2e6d90108c09 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:02.992382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89d4ed-ebb2-41e8-ac65-2e6d90108c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:02.992670 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89d4ed-ebb2-41e8-ac65-2e6d90108c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.002752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89d4ed-ebb2-41e8-ac65-2e6d90108c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:03.004193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89d4ed-ebb2-41e8-ac65-2e6d90108c09 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b4b23a5c-4ded-4324-8abd-5862986acedc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:03.010122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:03.011082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:03.011968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:03.011968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:03.011968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:03.011968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:03.011968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 294/569] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:03.012255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b23a5c-4ded-4324-8abd-5862986acedc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7e89d4ed-ebb2-41e8-ac65-2e6d90108c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:03.028430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:03.029485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:03.030662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:03.030662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:03.030662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:03.030662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:03.030662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 276/570] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:03.031260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1985-b4bf-465b-b5a1-9a6da50b9a49 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:03.031550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1985-b4bf-465b-b5a1-9a6da50b9a49 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:03.031827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1985-b4bf-465b-b5a1-9a6da50b9a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.048301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-eb2b1985-b4bf-465b-b5a1-9a6da50b9a49 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:03.049551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-eb2b1985-b4bf-465b-b5a1-9a6da50b9a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:03.116584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 277/571] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:03.118184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1985-b4bf-465b-b5a1-9a6da50b9a49 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.125480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b23a5c-4ded-4324-8abd-5862986acedc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:03.154508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:03.168045 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85d7f-87f1-48da-ba4a-4002a06a2257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:03.168842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85d7f-87f1-48da-ba4a-4002a06a2257 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:03.169166 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85d7f-87f1-48da-ba4a-4002a06a2257 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:03.169447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85d7f-87f1-48da-ba4a-4002a06a2257 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.177025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf85d7f-87f1-48da-ba4a-4002a06a2257 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:03.178972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf85d7f-87f1-48da-ba4a-4002a06a2257 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-5cf85d7f-87f1-48da-ba4a-4002a06a2257 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:03.193390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:03.196493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:03.197651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:03.197651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:03.197651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:03.197651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:03.197651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:03.197651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:03.197651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:03.197651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:03.197651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 295/572] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:03.197651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85d7f-87f1-48da-ba4a-4002a06a2257 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.216141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:03.237063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1985-b4bf-465b-b5a1-9a6da50b9a49 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:03.273455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e09cc-10ea-4c9f-a75b-a635fc3d75c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:03.274244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e09cc-10ea-4c9f-a75b-a635fc3d75c8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:03.274536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e09cc-10ea-4c9f-a75b-a635fc3d75c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:03.274819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e09cc-10ea-4c9f-a75b-a635fc3d75c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.275577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e09cc-10ea-4c9f-a75b-a635fc3d75c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:03.275886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e09cc-10ea-4c9f-a75b-a635fc3d75c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:03.277256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e09cc-10ea-4c9f-a75b-a635fc3d75c8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:03.285555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 278/573] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:03.286314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e09cc-10ea-4c9f-a75b-a635fc3d75c8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.313740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85d7f-87f1-48da-ba4a-4002a06a2257 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:03.347967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246ab82-bbd6-4a54-bddf-6ed16d30f5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:03.348635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ab82-bbd6-4a54-bddf-6ed16d30f5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:03.348921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ab82-bbd6-4a54-bddf-6ed16d30f5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:03.349206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246ab82-bbd6-4a54-bddf-6ed16d30f5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.349939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246ab82-bbd6-4a54-bddf-6ed16d30f5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:03.350306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246ab82-bbd6-4a54-bddf-6ed16d30f5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:03.351780 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246ab82-bbd6-4a54-bddf-6ed16d30f5a3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:03.363750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 296/574] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:03.364562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246ab82-bbd6-4a54-bddf-6ed16d30f5a3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.379045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:03.389779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e09cc-10ea-4c9f-a75b-a635fc3d75c8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:03.423355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0860-7c58-4f68-8a5a-2501a41a9dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:03.424029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0860-7c58-4f68-8a5a-2501a41a9dce None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:03.424315 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0860-7c58-4f68-8a5a-2501a41a9dce None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:03.424595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0860-7c58-4f68-8a5a-2501a41a9dce None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.425323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0860-7c58-4f68-8a5a-2501a41a9dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:03.425636 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0860-7c58-4f68-8a5a-2501a41a9dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:03.427047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb0860-7c58-4f68-8a5a-2501a41a9dce None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:03.437359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:03.439453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 279/575] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:03.440279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0860-7c58-4f68-8a5a-2501a41a9dce None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.470461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246ab82-bbd6-4a54-bddf-6ed16d30f5a3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:03.504861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd1e14-b019-4c70-b3bf-d912b744a5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:03.505662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd1e14-b019-4c70-b3bf-d912b744a5ef None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:03.505947 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd1e14-b019-4c70-b3bf-d912b744a5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:03.506256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd1e14-b019-4c70-b3bf-d912b744a5ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.517659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd1e14-b019-4c70-b3bf-d912b744a5ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-1bfd1e14-b019-4c70-b3bf-d912b744a5ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:03.526717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:03.527695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:03.528560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 297/576] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:03.529269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd1e14-b019-4c70-b3bf-d912b744a5ef None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.543150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0860-7c58-4f68-8a5a-2501a41a9dce None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:03.579977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670f926-e925-437c-bd45-2b89fd37b9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:03.580641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670f926-e925-437c-bd45-2b89fd37b9fb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:03.580924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670f926-e925-437c-bd45-2b89fd37b9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:03.581197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670f926-e925-437c-bd45-2b89fd37b9fb None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.581985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670f926-e925-437c-bd45-2b89fd37b9fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:03.582343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670f926-e925-437c-bd45-2b89fd37b9fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:03.583791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670f926-e925-437c-bd45-2b89fd37b9fb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:03.595861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 280/577] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:03.596898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670f926-e925-437c-bd45-2b89fd37b9fb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.611155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:03.640469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd1e14-b019-4c70-b3bf-d912b744a5ef None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:03.670181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:03.675342 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194f08b-bb2c-4207-b567-3831f3d8b862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:03.676142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194f08b-bb2c-4207-b567-3831f3d8b862 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:03.676427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194f08b-bb2c-4207-b567-3831f3d8b862 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:03.676707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194f08b-bb2c-4207-b567-3831f3d8b862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.688080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194f08b-bb2c-4207-b567-3831f3d8b862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:03.689551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194f08b-bb2c-4207-b567-3831f3d8b862 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:03.700561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670f926-e925-437c-bd45-2b89fd37b9fb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b194f08b-bb2c-4207-b567-3831f3d8b862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:03.706702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:03.707671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:03.708569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:03.708569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:03.708569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:03.708569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:03.708569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 298/578] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:03.709059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194f08b-bb2c-4207-b567-3831f3d8b862 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.739021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9cdc2-4617-4e1c-ab7d-2b19c32e1de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:03.739855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9cdc2-4617-4e1c-ab7d-2b19c32e1de4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:03.740158 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9cdc2-4617-4e1c-ab7d-2b19c32e1de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:03.740444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9cdc2-4617-4e1c-ab7d-2b19c32e1de4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.749893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9cdc2-4617-4e1c-ab7d-2b19c32e1de4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:03.751399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9cdc2-4617-4e1c-ab7d-2b19c32e1de4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-cbb9cdc2-4617-4e1c-ab7d-2b19c32e1de4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:03.765660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:03.766900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 281/579] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:03.768081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9cdc2-4617-4e1c-ab7d-2b19c32e1de4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.818984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194f08b-bb2c-4207-b567-3831f3d8b862 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:03.839318 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:03.853712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb382a4-45ff-429f-b808-d4eb069d32cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:03.854546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb382a4-45ff-429f-b808-d4eb069d32cf None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:03.854843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb382a4-45ff-429f-b808-d4eb069d32cf None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:03.855129 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb382a4-45ff-429f-b808-d4eb069d32cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.861841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb382a4-45ff-429f-b808-d4eb069d32cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:03.863402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb382a4-45ff-429f-b808-d4eb069d32cf None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:03.871147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9cdc2-4617-4e1c-ab7d-2b19c32e1de4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-2fb382a4-45ff-429f-b808-d4eb069d32cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:03.878728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:03.879832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:03.881213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:03.881213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:03.881213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:03.881213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:03.881213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:03.881213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:03.881213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:03.881213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:03.881213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 299/580] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:03.881213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb382a4-45ff-429f-b808-d4eb069d32cf None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.910122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283644f-a01e-445f-948c-6b39c5d85310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:03.910823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283644f-a01e-445f-948c-6b39c5d85310 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:03.911111 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283644f-a01e-445f-948c-6b39c5d85310 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:03.911391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283644f-a01e-445f-948c-6b39c5d85310 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:03.912148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283644f-a01e-445f-948c-6b39c5d85310 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:03.912461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283644f-a01e-445f-948c-6b39c5d85310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:03.913835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283644f-a01e-445f-948c-6b39c5d85310 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:03.922517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 282/581] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:03.923324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283644f-a01e-445f-948c-6b39c5d85310 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:03.933374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:03.991818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb382a4-45ff-429f-b808-d4eb069d32cf None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:04.027674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33fc4e-ed7f-4fc1-b69c-b44a665b7db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:04.028346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33fc4e-ed7f-4fc1-b69c-b44a665b7db7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:04.028636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33fc4e-ed7f-4fc1-b69c-b44a665b7db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:04.028925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33fc4e-ed7f-4fc1-b69c-b44a665b7db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:04.029776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33fc4e-ed7f-4fc1-b69c-b44a665b7db7 None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=945586c90ac148b8880b9ad6409b02f5) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:04.030096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33fc4e-ed7f-4fc1-b69c-b44a665b7db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:04.031579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33fc4e-ed7f-4fc1-b69c-b44a665b7db7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:04.031707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283644f-a01e-445f-948c-6b39c5d85310 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:04.037467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 300/582] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/role_assignments?user.id=945586c90ac148b8880b9ad6409b02f5&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:04.038337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33fc4e-ed7f-4fc1-b69c-b44a665b7db7 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:04.064775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:04.070518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beace38-650b-4853-887b-4002a117410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:04.071460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beace38-650b-4853-887b-4002a117410e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:04.071749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beace38-650b-4853-887b-4002a117410e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:04.072025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beace38-650b-4853-887b-4002a117410e None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:04.072782 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beace38-650b-4853-887b-4002a117410e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:04.073099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beace38-650b-4853-887b-4002a117410e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:04.074528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beace38-650b-4853-887b-4002a117410e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:04.089037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 283/583] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:04.090020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beace38-650b-4853-887b-4002a117410e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:04.172369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33fc4e-ed7f-4fc1-b69c-b44a665b7db7 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:04.183112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:04.214139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beace38-650b-4853-887b-4002a117410e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:04.221561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0bc1-0bbe-44e4-bcd1-43ace2fc7ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:04.222312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0bc1-0bbe-44e4-bcd1-43ace2fc7ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:04.222721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0bc1-0bbe-44e4-bcd1-43ace2fc7ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:04.223007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d0bc1-0bbe-44e4-bcd1-43ace2fc7ce5 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:04.223867 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0bc1-0bbe-44e4-bcd1-43ace2fc7ce5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:04.224254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0bc1-0bbe-44e4-bcd1-43ace2fc7ce5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:04.225731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d0bc1-0bbe-44e4-bcd1-43ace2fc7ce5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:04.250653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 301/584] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 11 14:00:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:04.250653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0bc1-0bbe-44e4-bcd1-43ace2fc7ce5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:04.255432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfc496-e6f1-4ba8-bacf-ee0e9370c504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:04.256110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc496-e6f1-4ba8-bacf-ee0e9370c504 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:04.256395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc496-e6f1-4ba8-bacf-ee0e9370c504 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:04.256678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc496-e6f1-4ba8-bacf-ee0e9370c504 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:04.257481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfc496-e6f1-4ba8-bacf-ee0e9370c504 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:04.258414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfc496-e6f1-4ba8-bacf-ee0e9370c504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:04.260396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfc496-e6f1-4ba8-bacf-ee0e9370c504 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:04.272938 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 284/585] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:04.274594 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfc496-e6f1-4ba8-bacf-ee0e9370c504 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:04.333251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:04.366035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d0bc1-0bbe-44e4-bcd1-43ace2fc7ce5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:04.385534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfc496-e6f1-4ba8-bacf-ee0e9370c504 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:04.404059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37018338-65b4-4beb-810e-f474314a35f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:04.405138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018338-65b4-4beb-810e-f474314a35f5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:04.405603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018338-65b4-4beb-810e-f474314a35f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:04.406230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018338-65b4-4beb-810e-f474314a35f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:04.417603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37018338-65b4-4beb-810e-f474314a35f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:04.419094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37018338-65b4-4beb-810e-f474314a35f5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:04.420800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4f630-cd30-43e8-9c4d-f42dd7d5dabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:04.421599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f630-cd30-43e8-9c4d-f42dd7d5dabf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:04.421886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f630-cd30-43e8-9c4d-f42dd7d5dabf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:04.422189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f630-cd30-43e8-9c4d-f42dd7d5dabf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:04.430740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4f630-cd30-43e8-9c4d-f42dd7d5dabf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:04.432203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4f630-cd30-43e8-9c4d-f42dd7d5dabf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-37018338-65b4-4beb-810e-f474314a35f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:04.439377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:04.440286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:04.441192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:04.441192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:04.441192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:04.441192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:04.448498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 302/586] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:04.448498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37018338-65b4-4beb-810e-f474314a35f5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1ad4f630-cd30-43e8-9c4d-f42dd7d5dabf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:04.448726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:04.449616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:04.450598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:04.450598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:04.450598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:04.450598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:04.450598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:04.450598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:04.450598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:04.450598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:04.450598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:00:04.450598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:04.453552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 285/587] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:04.454409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4f630-cd30-43e8-9c4d-f42dd7d5dabf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:04.466407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:04.565691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37018338-65b4-4beb-810e-f474314a35f5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:04.568096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4f630-cd30-43e8-9c4d-f42dd7d5dabf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:04.589727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:04.604433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dbbaf-19aa-48d8-98ce-00ee27cab06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:04.604935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dbbaf-19aa-48d8-98ce-00ee27cab06c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:04.605218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dbbaf-19aa-48d8-98ce-00ee27cab06c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:04.605493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dbbaf-19aa-48d8-98ce-00ee27cab06c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:04.616054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dbbaf-19aa-48d8-98ce-00ee27cab06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:04.618182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718dbbaf-19aa-48d8-98ce-00ee27cab06c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:04.626993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4f14f-e4c1-44f7-a0ce-065f6dd4cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:04.628637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f14f-e4c1-44f7-a0ce-065f6dd4cd19 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:04.629119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f14f-e4c1-44f7-a0ce-065f6dd4cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:04.629593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f14f-e4c1-44f7-a0ce-065f6dd4cd19 None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/38a31386700941c9b103720a64bac405/roles/2fe302f59f134744aaac6a31934efeea` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-718dbbaf-19aa-48d8-98ce-00ee27cab06c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:04.638625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:04.639482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:04.640391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:04.640391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:04.640391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:04.640391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:04.641986 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 303/588] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:04.642917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dbbaf-19aa-48d8-98ce-00ee27cab06c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:04.655549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4f14f-e4c1-44f7-a0ce-065f6dd4cd19 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=38a31386700941c9b103720a64bac405, role_id=2fe302f59f134744aaac6a31934efeea)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:04.658211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4f14f-e4c1-44f7-a0ce-065f6dd4cd19 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:04.676910 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 286/589] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:00:04 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/38a31386700941c9b103720a64bac405/roles/2fe302f59f134744aaac6a31934efeea => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:00:04.679342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4f14f-e4c1-44f7-a0ce-065f6dd4cd19 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:04.745070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:04.788816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dbbaf-19aa-48d8-98ce-00ee27cab06c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:04.815412 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4f14f-e4c1-44f7-a0ce-065f6dd4cd19 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:04.832748 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d328-b66b-491e-b11b-a29df0d3fe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:04.833618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d328-b66b-491e-b11b-a29df0d3fe61 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:04.834007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d328-b66b-491e-b11b-a29df0d3fe61 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:04.834421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763d328-b66b-491e-b11b-a29df0d3fe61 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:04.835377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763d328-b66b-491e-b11b-a29df0d3fe61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:04.835823 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763d328-b66b-491e-b11b-a29df0d3fe61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:04.837558 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763d328-b66b-491e-b11b-a29df0d3fe61 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:04.854414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 304/590] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:04.855661 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d328-b66b-491e-b11b-a29df0d3fe61 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:04.860011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d2677-4c0b-403d-ac39-c2a741e30584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:04.860983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d2677-4c0b-403d-ac39-c2a741e30584 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:04.861473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d2677-4c0b-403d-ac39-c2a741e30584 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:04.861973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d2677-4c0b-403d-ac39-c2a741e30584 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:04.863128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d2677-4c0b-403d-ac39-c2a741e30584 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:04.863696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d2677-4c0b-403d-ac39-c2a741e30584 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:04.865408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d2677-4c0b-403d-ac39-c2a741e30584 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:04.887048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 287/591] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 11 14:00:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:04.893502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d2677-4c0b-403d-ac39-c2a741e30584 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:04.918199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:04.993839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763d328-b66b-491e-b11b-a29df0d3fe61 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:05.008908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d2677-4c0b-403d-ac39-c2a741e30584 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:05.024026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:05.032665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb15f5-90d1-4dc1-be8e-320077e7b50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:05.033765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb15f5-90d1-4dc1-be8e-320077e7b50d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:05.034093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb15f5-90d1-4dc1-be8e-320077e7b50d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:05.034579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb15f5-90d1-4dc1-be8e-320077e7b50d None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:05.036202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb15f5-90d1-4dc1-be8e-320077e7b50d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:05.036713 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb15f5-90d1-4dc1-be8e-320077e7b50d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:05.038822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb15f5-90d1-4dc1-be8e-320077e7b50d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:05.047227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8576b-2f55-4151-a388-0b7a3fae8d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:05.048036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8576b-2f55-4151-a388-0b7a3fae8d85 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:05.048528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8576b-2f55-4151-a388-0b7a3fae8d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:05.048817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8576b-2f55-4151-a388-0b7a3fae8d85 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:05.057466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8576b-2f55-4151-a388-0b7a3fae8d85 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:05.057617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 305/592] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:05.058371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb15f5-90d1-4dc1-be8e-320077e7b50d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:05.058989 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8576b-2f55-4151-a388-0b7a3fae8d85 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-36a8576b-2f55-4151-a388-0b7a3fae8d85 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:05.076155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:05.077166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:05.078122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:05.078122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:05.078122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:05.078122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:05.078122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:05.078122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:05.078122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:05.078122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:05.078122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:00:05.078122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:05.078122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 288/593] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:05.078779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8576b-2f55-4151-a388-0b7a3fae8d85 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:05.175417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:05.196777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8576b-2f55-4151-a388-0b7a3fae8d85 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:05.197227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb15f5-90d1-4dc1-be8e-320077e7b50d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:05.236074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e612a-f357-4bf7-91de-dd55f6952c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:05.236993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b7dd5-ee2e-48a0-a254-545c1715e511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:05.237422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e612a-f357-4bf7-91de-dd55f6952c98 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:05.237791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b7dd5-ee2e-48a0-a254-545c1715e511 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:05.238078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b7dd5-ee2e-48a0-a254-545c1715e511 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:05.238269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e612a-f357-4bf7-91de-dd55f6952c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:05.238409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b7dd5-ee2e-48a0-a254-545c1715e511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:05.238845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e612a-f357-4bf7-91de-dd55f6952c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:05.246855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b7dd5-ee2e-48a0-a254-545c1715e511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:05.248362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b7dd5-ee2e-48a0-a254-545c1715e511 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:05.252317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e612a-f357-4bf7-91de-dd55f6952c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:05.254001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e612a-f357-4bf7-91de-dd55f6952c98 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c07b7dd5-ee2e-48a0-a254-545c1715e511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:05.264537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:05.265483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:05.266425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:05.266425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:05.266425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:05.266425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:05.266425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:05.266425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:05.266425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:05.266425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:05.266425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 289/594] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:05.266977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b7dd5-ee2e-48a0-a254-545c1715e511 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-6a4e612a-f357-4bf7-91de-dd55f6952c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:05.280962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:05.281928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:05.282849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:05.282849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:05.282849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:05.282849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:05.286745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 306/595] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:05.287632 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e612a-f357-4bf7-91de-dd55f6952c98 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:05.349592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:05.392336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b7dd5-ee2e-48a0-a254-545c1715e511 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:05.423733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e612a-f357-4bf7-91de-dd55f6952c98 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:05.437084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ff72d-5e74-4636-a1f2-16aaee66a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:05.438149 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ff72d-5e74-4636-a1f2-16aaee66a802 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:05.438743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ff72d-5e74-4636-a1f2-16aaee66a802 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:05.439256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ff72d-5e74-4636-a1f2-16aaee66a802 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:05.440359 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ff72d-5e74-4636-a1f2-16aaee66a802 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:05.440878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ff72d-5e74-4636-a1f2-16aaee66a802 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:05.442789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ff72d-5e74-4636-a1f2-16aaee66a802 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:05.453508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:05.461898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55ef81-340a-4bef-9344-d52a501601be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:05.462978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ef81-340a-4bef-9344-d52a501601be None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:05.463407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ef81-340a-4bef-9344-d52a501601be None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:05.463820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ef81-340a-4bef-9344-d52a501601be None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:05.463951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 290/596] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Jul 11 14:00:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:05.464840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ff72d-5e74-4636-a1f2-16aaee66a802 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:05.465184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55ef81-340a-4bef-9344-d52a501601be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:05.465760 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55ef81-340a-4bef-9344-d52a501601be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:05.467416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55ef81-340a-4bef-9344-d52a501601be None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:05.481406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 307/597] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:05.482599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55ef81-340a-4bef-9344-d52a501601be None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:05.576353 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ff72d-5e74-4636-a1f2-16aaee66a802 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:05.591343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55ef81-340a-4bef-9344-d52a501601be None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:05.593468 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:05.618825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd5097-c666-4dd1-9b92-55903e7b3da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:05.619686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd5097-c666-4dd1-9b92-55903e7b3da9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:05.620084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd5097-c666-4dd1-9b92-55903e7b3da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:05.620709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd5097-c666-4dd1-9b92-55903e7b3da9 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:05.621318 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd5097-c666-4dd1-9b92-55903e7b3da9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:05.621778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd5097-c666-4dd1-9b92-55903e7b3da9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:05.623327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd5097-c666-4dd1-9b92-55903e7b3da9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:05.632207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72464d58-6a33-4ae3-984e-e3fa463e7f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:05.633968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72464d58-6a33-4ae3-984e-e3fa463e7f86 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:05.634495 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72464d58-6a33-4ae3-984e-e3fa463e7f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:05.635011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72464d58-6a33-4ae3-984e-e3fa463e7f86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:05.636353 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 291/598] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:05.637327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd5097-c666-4dd1-9b92-55903e7b3da9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:05.647259 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72464d58-6a33-4ae3-984e-e3fa463e7f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:05.649148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72464d58-6a33-4ae3-984e-e3fa463e7f86 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-72464d58-6a33-4ae3-984e-e3fa463e7f86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:05.668237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:05.669152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:05.670051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:05.670051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:05.670051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:05.670051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:05.672519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 308/599] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:05.673496 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72464d58-6a33-4ae3-984e-e3fa463e7f86 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:05.703026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:05.748704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd5097-c666-4dd1-9b92-55903e7b3da9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:05.783548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72464d58-6a33-4ae3-984e-e3fa463e7f86 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:05.786997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb3afe-ed28-49b7-9aa5-9d50294ac641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:05.787482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb3afe-ed28-49b7-9aa5-9d50294ac641 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:05.787772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb3afe-ed28-49b7-9aa5-9d50294ac641 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:05.788050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb3afe-ed28-49b7-9aa5-9d50294ac641 None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/a5cf559c8a69483ca7625f37d5931439/roles/2fe302f59f134744aaac6a31934efeea` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:05.806089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb3afe-ed28-49b7-9aa5-9d50294ac641 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=a5cf559c8a69483ca7625f37d5931439, role_id=2fe302f59f134744aaac6a31934efeea)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:05.807843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb3afe-ed28-49b7-9aa5-9d50294ac641 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:05.823235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42687121-e76b-4128-92fe-f762f7330712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:05.824023 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 292/600] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:00:05 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/a5cf559c8a69483ca7625f37d5931439/roles/2fe302f59f134744aaac6a31934efeea => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:00:05.824623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42687121-e76b-4128-92fe-f762f7330712 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:05.825029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb3afe-ed28-49b7-9aa5-9d50294ac641 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:05.825436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42687121-e76b-4128-92fe-f762f7330712 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:05.825913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42687121-e76b-4128-92fe-f762f7330712 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:05.834873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42687121-e76b-4128-92fe-f762f7330712 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:05.837108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42687121-e76b-4128-92fe-f762f7330712 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-42687121-e76b-4128-92fe-f762f7330712 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:05.855456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:05.857783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:05.858727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:05.858727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:05.858727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:05.858727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:05.858727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:05.858727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:05.858727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:05.858727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:05.861504 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 309/601] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:05.868219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42687121-e76b-4128-92fe-f762f7330712 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:05.898032 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:05.965428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb3afe-ed28-49b7-9aa5-9d50294ac641 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:05.986558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:06.015536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481245b1-a928-4b35-9e2f-bf0d2783e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:06.016681 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481245b1-a928-4b35-9e2f-bf0d2783e042 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:06.017124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481245b1-a928-4b35-9e2f-bf0d2783e042 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:06.017722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481245b1-a928-4b35-9e2f-bf0d2783e042 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:06.019198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481245b1-a928-4b35-9e2f-bf0d2783e042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:06.019682 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481245b1-a928-4b35-9e2f-bf0d2783e042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:06.022048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481245b1-a928-4b35-9e2f-bf0d2783e042 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:06.036204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 293/602] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:06.043200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481245b1-a928-4b35-9e2f-bf0d2783e042 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:06.105824 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42687121-e76b-4128-92fe-f762f7330712 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:06.159476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b6ff-f7f5-4864-8efb-18b7221db974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:06.160418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b6ff-f7f5-4864-8efb-18b7221db974 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:06.160858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b6ff-f7f5-4864-8efb-18b7221db974 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:06.161287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b6ff-f7f5-4864-8efb-18b7221db974 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:06.162297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070b6ff-f7f5-4864-8efb-18b7221db974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:06.162826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070b6ff-f7f5-4864-8efb-18b7221db974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:06.164524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070b6ff-f7f5-4864-8efb-18b7221db974 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:06.190650 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 310/603] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:06.197336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b6ff-f7f5-4864-8efb-18b7221db974 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:06.214181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481245b1-a928-4b35-9e2f-bf0d2783e042 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:06.252848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e946b4e-db04-47b7-a768-8be2e03a7fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:06.253659 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e946b4e-db04-47b7-a768-8be2e03a7fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:06.253943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e946b4e-db04-47b7-a768-8be2e03a7fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:06.254252 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e946b4e-db04-47b7-a768-8be2e03a7fa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:06.262673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e946b4e-db04-47b7-a768-8be2e03a7fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:06.264345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e946b4e-db04-47b7-a768-8be2e03a7fa2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8e946b4e-db04-47b7-a768-8be2e03a7fa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:06.281999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:06.283013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:06.283898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:06.283898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:06.283898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:06.283898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:06.283898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:06.283898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:06.283898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:06.283898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:06.283898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 294/604] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:06.289446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e946b4e-db04-47b7-a768-8be2e03a7fa2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:06.330649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:06.390449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:06.410151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e946b4e-db04-47b7-a768-8be2e03a7fa2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:06.422670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b6ff-f7f5-4864-8efb-18b7221db974 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:06.452824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d57a99-3558-4766-b738-29bc3d16db1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:06.453642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d57a99-3558-4766-b738-29bc3d16db1f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:06.454293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d57a99-3558-4766-b738-29bc3d16db1f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:06.454581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d57a99-3558-4766-b738-29bc3d16db1f None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:06.455665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d57a99-3558-4766-b738-29bc3d16db1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:06.455982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d57a99-3558-4766-b738-29bc3d16db1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:06.458109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d57a99-3558-4766-b738-29bc3d16db1f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:06.466180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9a539-7ba2-42a9-a3e4-f1168ab0674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:06.467737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a539-7ba2-42a9-a3e4-f1168ab0674c None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:06.468095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a539-7ba2-42a9-a3e4-f1168ab0674c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:06.468474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9a539-7ba2-42a9-a3e4-f1168ab0674c None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/690a93a4d6ed4666a607b05a8c2b6549/roles/2fe302f59f134744aaac6a31934efeea` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:06.472538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 295/605] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:06.473923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72e329-bf8a-40da-8c45-768a587fb375 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:06.474348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72e329-bf8a-40da-8c45-768a587fb375 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:06.474731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72e329-bf8a-40da-8c45-768a587fb375 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:06.476336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 296/606] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:06.483339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72e329-bf8a-40da-8c45-768a587fb375 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:06.495586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9a539-7ba2-42a9-a3e4-f1168ab0674c None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=690a93a4d6ed4666a607b05a8c2b6549, role_id=2fe302f59f134744aaac6a31934efeea)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:06.497778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9a539-7ba2-42a9-a3e4-f1168ab0674c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:06.517686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 311/607] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:00:06 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/690a93a4d6ed4666a607b05a8c2b6549/roles/2fe302f59f134744aaac6a31934efeea => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:00:06.519915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6ffe-50ab-4074-9c4d-4078e6a33033 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:06.520508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6ffe-50ab-4074-9c4d-4078e6a33033 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:06.520791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df6ffe-50ab-4074-9c4d-4078e6a33033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:06.550278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-30df6ffe-50ab-4074-9c4d-4078e6a33033 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:06.550278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-30df6ffe-50ab-4074-9c4d-4078e6a33033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:06.671152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:06.698728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 312/608] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:06.699789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72e329-bf8a-40da-8c45-768a587fb375 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:06.729829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df6ffe-50ab-4074-9c4d-4078e6a33033 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:06.744110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201d5d1-ab33-4ceb-ad20-04b56842e416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:06.745011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201d5d1-ab33-4ceb-ad20-04b56842e416 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:06.745338 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201d5d1-ab33-4ceb-ad20-04b56842e416 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:06.745608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201d5d1-ab33-4ceb-ad20-04b56842e416 None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/4426582f945e4c90bf8debd2ecbd9769/roles/2fe302f59f134744aaac6a31934efeea` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:06.762858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201d5d1-ab33-4ceb-ad20-04b56842e416 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=4426582f945e4c90bf8debd2ecbd9769, role_id=2fe302f59f134744aaac6a31934efeea)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:06.764370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201d5d1-ab33-4ceb-ad20-04b56842e416 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:06.780904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 297/609] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:00:06 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/4426582f945e4c90bf8debd2ecbd9769/roles/2fe302f59f134744aaac6a31934efeea => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:00:06.825662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:06.901797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df6ffe-50ab-4074-9c4d-4078e6a33033 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:06.952532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16041c-d155-40c4-b532-44328d7153af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:06.953380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16041c-d155-40c4-b532-44328d7153af None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:06.953669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16041c-d155-40c4-b532-44328d7153af None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:06.953951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16041c-d155-40c4-b532-44328d7153af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:06.974095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16041c-d155-40c4-b532-44328d7153af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-ec16041c-d155-40c4-b532-44328d7153af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:06.982575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:06.983788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:06.984643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 313/610] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:06.992639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201d5d1-ab33-4ceb-ad20-04b56842e416 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:07.110214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36239f-ed42-41c0-895b-5da6fbbd3d84 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:07.110214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36239f-ed42-41c0-895b-5da6fbbd3d84 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:07.110214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36239f-ed42-41c0-895b-5da6fbbd3d84 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:07.111013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 314/611] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:07.113213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201d5d1-ab33-4ceb-ad20-04b56842e416 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:07.116751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac2a9-33a5-476e-8a2e-e098e1f1c488 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:07.117357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac2a9-33a5-476e-8a2e-e098e1f1c488 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:07.117988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aac2a9-33a5-476e-8a2e-e098e1f1c488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:07.135925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d6aac2a9-33a5-476e-8a2e-e098e1f1c488 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:07.137496 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d6aac2a9-33a5-476e-8a2e-e098e1f1c488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:07.149908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b388a5-66cc-4cb1-8daf-0b2ea6667989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:07.150611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b388a5-66cc-4cb1-8daf-0b2ea6667989 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:07.151200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b388a5-66cc-4cb1-8daf-0b2ea6667989 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:07.151322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b388a5-66cc-4cb1-8daf-0b2ea6667989 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:07.152002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b388a5-66cc-4cb1-8daf-0b2ea6667989 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:07.152309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b388a5-66cc-4cb1-8daf-0b2ea6667989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:07.153679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b388a5-66cc-4cb1-8daf-0b2ea6667989 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:07.163033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 298/612] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:07.163341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:07.175180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b388a5-66cc-4cb1-8daf-0b2ea6667989 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:07.270133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 315/613] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:00:07.327175 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aac2a9-33a5-476e-8a2e-e098e1f1c488 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:07.381974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b388a5-66cc-4cb1-8daf-0b2ea6667989 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:07.389486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:07.466493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb98ea4-c6fa-47dd-9eef-1fd57873c259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:07.467296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98ea4-c6fa-47dd-9eef-1fd57873c259 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:07.467585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98ea4-c6fa-47dd-9eef-1fd57873c259 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:07.467868 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98ea4-c6fa-47dd-9eef-1fd57873c259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:07.486250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aac2a9-33a5-476e-8a2e-e098e1f1c488 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:07.489333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb98ea4-c6fa-47dd-9eef-1fd57873c259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:07.490801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb98ea4-c6fa-47dd-9eef-1fd57873c259 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:07.544674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8297f-e8c8-42bb-a53c-34653fa1cf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:07.545404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8297f-e8c8-42bb-a53c-34653fa1cf20 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:07.545695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8297f-e8c8-42bb-a53c-34653fa1cf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:07.545975 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8297f-e8c8-42bb-a53c-34653fa1cf20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8fb98ea4-c6fa-47dd-9eef-1fd57873c259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:07.546826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:07.547744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:07.548677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:07.548677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:07.548677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:07.548677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:07.548677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 299/614] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:07.555975 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb98ea4-c6fa-47dd-9eef-1fd57873c259 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:07.572341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8297f-e8c8-42bb-a53c-34653fa1cf20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-f1a8297f-e8c8-42bb-a53c-34653fa1cf20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:07.580301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:07.581233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:07.582081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:07.595476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 316/615] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:07.611152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8297f-e8c8-42bb-a53c-34653fa1cf20 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:07.672822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:07.735224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb98ea4-c6fa-47dd-9eef-1fd57873c259 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:07.771915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f691455-e00b-45eb-8a3f-a3c51f5d82fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:07.772598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f691455-e00b-45eb-8a3f-a3c51f5d82fd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:07.772886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f691455-e00b-45eb-8a3f-a3c51f5d82fd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:07.773170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f691455-e00b-45eb-8a3f-a3c51f5d82fd None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:07.774461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f691455-e00b-45eb-8a3f-a3c51f5d82fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:07.774772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f691455-e00b-45eb-8a3f-a3c51f5d82fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:07.776164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f691455-e00b-45eb-8a3f-a3c51f5d82fd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:07.789811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 300/616] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:07.791066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8297f-e8c8-42bb-a53c-34653fa1cf20 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:07.795734 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f691455-e00b-45eb-8a3f-a3c51f5d82fd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:07.796213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:07.851136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943386f-ee2d-4021-919b-0f8be879039c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:07.853009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943386f-ee2d-4021-919b-0f8be879039c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:07.853512 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943386f-ee2d-4021-919b-0f8be879039c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:07.854009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943386f-ee2d-4021-919b-0f8be879039c None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:07.854996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943386f-ee2d-4021-919b-0f8be879039c None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:07.855514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943386f-ee2d-4021-919b-0f8be879039c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:07.857114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943386f-ee2d-4021-919b-0f8be879039c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:07.873053 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 317/617] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:07.879618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943386f-ee2d-4021-919b-0f8be879039c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:07.912101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f691455-e00b-45eb-8a3f-a3c51f5d82fd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:07.927491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:07.963795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21bfdd-767d-4a05-8cd9-1ee10007547f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:07.964606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21bfdd-767d-4a05-8cd9-1ee10007547f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:07.964891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21bfdd-767d-4a05-8cd9-1ee10007547f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:07.965167 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21bfdd-767d-4a05-8cd9-1ee10007547f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:07.982140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21bfdd-767d-4a05-8cd9-1ee10007547f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:07.986447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b21bfdd-767d-4a05-8cd9-1ee10007547f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9b21bfdd-767d-4a05-8cd9-1ee10007547f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:08.017265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:08.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:08.019319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:08.019319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:08.019319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:08.019319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:08.019319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:08.019319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:08.019319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:08.019319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:08.019319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:08.019319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:08.019319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 301/618] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:08.026522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21bfdd-767d-4a05-8cd9-1ee10007547f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:08.066607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943386f-ee2d-4021-919b-0f8be879039c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:08.113630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43818a6-aa48-48e2-bf9f-16e223ee6d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:08.116748 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43818a6-aa48-48e2-bf9f-16e223ee6d9a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:08.117591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43818a6-aa48-48e2-bf9f-16e223ee6d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:08.117925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43818a6-aa48-48e2-bf9f-16e223ee6d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:08.131863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43818a6-aa48-48e2-bf9f-16e223ee6d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:08.133873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43818a6-aa48-48e2-bf9f-16e223ee6d9a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-f43818a6-aa48-48e2-bf9f-16e223ee6d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:08.169181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:08.171417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:08.173658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:08.173658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:08.173658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:08.173658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:08.179073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 318/619] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:08.185119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43818a6-aa48-48e2-bf9f-16e223ee6d9a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:08.188831 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21bfdd-767d-4a05-8cd9-1ee10007547f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:08.230774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedb3b9-55f2-428a-9976-4bda3c6e2de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:08.231540 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedb3b9-55f2-428a-9976-4bda3c6e2de9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:08.231897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedb3b9-55f2-428a-9976-4bda3c6e2de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:08.232243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedb3b9-55f2-428a-9976-4bda3c6e2de9 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:08.233173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedb3b9-55f2-428a-9976-4bda3c6e2de9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:08.233594 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedb3b9-55f2-428a-9976-4bda3c6e2de9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:08.235216 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedb3b9-55f2-428a-9976-4bda3c6e2de9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:08.250844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:08.254907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 302/620] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Jul 11 14:00:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:08.263180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedb3b9-55f2-428a-9976-4bda3c6e2de9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:08.297096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:08.352163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43818a6-aa48-48e2-bf9f-16e223ee6d9a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:08.380376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedb3b9-55f2-428a-9976-4bda3c6e2de9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:08.399580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ada3d-86a9-4082-959d-e2c52eae6bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:08.400257 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ada3d-86a9-4082-959d-e2c52eae6bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:08.400546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ada3d-86a9-4082-959d-e2c52eae6bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:08.400824 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ada3d-86a9-4082-959d-e2c52eae6bf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:08.401562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ada3d-86a9-4082-959d-e2c52eae6bf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:08.401872 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ada3d-86a9-4082-959d-e2c52eae6bf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:08.403347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ada3d-86a9-4082-959d-e2c52eae6bf0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:08.416772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 319/621] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:08.418236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17443d13-f0e7-4da1-a89f-1855519557c3 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:08.418537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17443d13-f0e7-4da1-a89f-1855519557c3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:08.418822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17443d13-f0e7-4da1-a89f-1855519557c3 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:08.424052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 320/622] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:08.424052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17443d13-f0e7-4da1-a89f-1855519557c3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:08.432124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eef24-857e-497b-ad6d-1d0e0cc8e1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:08.434046 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eef24-857e-497b-ad6d-1d0e0cc8e1da None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:08.434569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eef24-857e-497b-ad6d-1d0e0cc8e1da None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:08.435041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eef24-857e-497b-ad6d-1d0e0cc8e1da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:08.450096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52eef24-857e-497b-ad6d-1d0e0cc8e1da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:08.452460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52eef24-857e-497b-ad6d-1d0e0cc8e1da None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-f52eef24-857e-497b-ad6d-1d0e0cc8e1da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:08.478390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:08.479923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:08.481024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:08.481024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:08.481024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:08.481024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:08.483375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 303/623] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:08.485406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c490-e018-46ef-bec6-a51bbf1e3568 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:08.485853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c490-e018-46ef-bec6-a51bbf1e3568 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:08.486578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7c490-e018-46ef-bec6-a51bbf1e3568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:08.510809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-dce7c490-e018-46ef-bec6-a51bbf1e3568 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:08.512706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dce7c490-e018-46ef-bec6-a51bbf1e3568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:08.513876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:08.551278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17443d13-f0e7-4da1-a89f-1855519557c3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:08.594127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 304/624] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:08.595771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7c490-e018-46ef-bec6-a51bbf1e3568 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:08.611604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7f803-5eaf-48cc-beff-ddc123a3ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:08.612679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7f803-5eaf-48cc-beff-ddc123a3ee48 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:08.613120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7f803-5eaf-48cc-beff-ddc123a3ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:08.613997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7f803-5eaf-48cc-beff-ddc123a3ee48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:08.618329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:08.625654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7f803-5eaf-48cc-beff-ddc123a3ee48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:08.627908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7f803-5eaf-48cc-beff-ddc123a3ee48 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-52d7f803-5eaf-48cc-beff-ddc123a3ee48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:08.651463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:08.652725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:08.653901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:08.653901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:08.653901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:08.653901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:08.653901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:08.653901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:08.653901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:08.653901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:08.653901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:08.653901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:08.657424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 321/625] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 11 14:00:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:08.658537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7f803-5eaf-48cc-beff-ddc123a3ee48 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:08.728679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7c490-e018-46ef-bec6-a51bbf1e3568 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:08.775353 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441148e7-f037-49c6-b799-ff45441b86e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:08.776278 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441148e7-f037-49c6-b799-ff45441b86e1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:08.776732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441148e7-f037-49c6-b799-ff45441b86e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:08.777150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441148e7-f037-49c6-b799-ff45441b86e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:08.778088 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441148e7-f037-49c6-b799-ff45441b86e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:08.779068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441148e7-f037-49c6-b799-ff45441b86e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:08.780859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441148e7-f037-49c6-b799-ff45441b86e1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:08.791604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7f803-5eaf-48cc-beff-ddc123a3ee48 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:08.799753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 305/626] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:08.801435 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441148e7-f037-49c6-b799-ff45441b86e1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:08.838544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7efe2a-80ee-4172-aba4-8fd4186998e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:08.839512 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7efe2a-80ee-4172-aba4-8fd4186998e5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:08.839902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7efe2a-80ee-4172-aba4-8fd4186998e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:08.840287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7efe2a-80ee-4172-aba4-8fd4186998e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:08.847928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:08.853893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7efe2a-80ee-4172-aba4-8fd4186998e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8c7efe2a-80ee-4172-aba4-8fd4186998e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:08.862415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:08.863372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:08.864219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:08.871785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 322/627] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:08.872980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7efe2a-80ee-4172-aba4-8fd4186998e5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:08.892134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:08.928886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441148e7-f037-49c6-b799-ff45441b86e1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:08.967381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c84e8-5c93-473f-ab85-915f5f02a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:08.968072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c84e8-5c93-473f-ab85-915f5f02a516 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:08.968409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c84e8-5c93-473f-ab85-915f5f02a516 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:08.968634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c84e8-5c93-473f-ab85-915f5f02a516 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:08.969496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c84e8-5c93-473f-ab85-915f5f02a516 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:08.969812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c84e8-5c93-473f-ab85-915f5f02a516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:08.971324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c84e8-5c93-473f-ab85-915f5f02a516 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:08.990035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7efe2a-80ee-4172-aba4-8fd4186998e5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:08.994538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 306/628] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 11 14:00:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:08.995473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c84e8-5c93-473f-ab85-915f5f02a516 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:09.030289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1c9ee-53e6-4988-aeb6-61883418017b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:09.031666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c9ee-53e6-4988-aeb6-61883418017b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.032166 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c9ee-53e6-4988-aeb6-61883418017b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.032674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c9ee-53e6-4988-aeb6-61883418017b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.041251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1c9ee-53e6-4988-aeb6-61883418017b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:09.042983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1c9ee-53e6-4988-aeb6-61883418017b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a1d1c9ee-53e6-4988-aeb6-61883418017b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:09.058105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:09.059253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:09.060338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:09.060338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:09.060338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:09.060338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:09.060338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:09.060338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:09.060338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:09.060338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:09.062225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 323/629] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:09.063301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1c9ee-53e6-4988-aeb6-61883418017b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:09.113485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c84e8-5c93-473f-ab85-915f5f02a516 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:09.132019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:09.152044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:09.159225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead9910-2e2b-42f3-952e-01445d066f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:09.159893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead9910-2e2b-42f3-952e-01445d066f95 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.160180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead9910-2e2b-42f3-952e-01445d066f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.160467 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead9910-2e2b-42f3-952e-01445d066f95 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.161195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead9910-2e2b-42f3-952e-01445d066f95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:09.161570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead9910-2e2b-42f3-952e-01445d066f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:09.162901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead9910-2e2b-42f3-952e-01445d066f95 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:09.171689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 307/630] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:09.172832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225f89-a521-428c-a92d-3acd680759a6 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.173121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225f89-a521-428c-a92d-3acd680759a6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.173394 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225f89-a521-428c-a92d-3acd680759a6 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.174775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 308/631] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:09.179203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07225f89-a521-428c-a92d-3acd680759a6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:09.183035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1c9ee-53e6-4988-aeb6-61883418017b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:09.226277 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc316f5-0779-436f-9c64-287402128fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:09.227125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc316f5-0779-436f-9c64-287402128fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.227390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc316f5-0779-436f-9c64-287402128fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.227658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc316f5-0779-436f-9c64-287402128fb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.294402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07225f89-a521-428c-a92d-3acd680759a6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:09.302751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc316f5-0779-436f-9c64-287402128fb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:09.304239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc316f5-0779-436f-9c64-287402128fb1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:09.332463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b273e-cba0-4b76-b066-331cbb35f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:09.333128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b273e-cba0-4b76-b066-331cbb35f442 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.333410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b273e-cba0-4b76-b066-331cbb35f442 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.333686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b273e-cba0-4b76-b066-331cbb35f442 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.334504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b273e-cba0-4b76-b066-331cbb35f442 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:09.334819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b273e-cba0-4b76-b066-331cbb35f442 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:09.336768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b273e-cba0-4b76-b066-331cbb35f442 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:09.348809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 309/632] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:09.349623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b273e-cba0-4b76-b066-331cbb35f442 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:09.367400 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:09.404519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:09.411494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 324/633] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:00:09.412782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd1d81-dcd0-4236-be28-bf1cf428e627 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.413078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd1d81-dcd0-4236-be28-bf1cf428e627 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.413361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd1d81-dcd0-4236-be28-bf1cf428e627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.430096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1ccd1d81-dcd0-4236-be28-bf1cf428e627 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:09.431821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1ccd1d81-dcd0-4236-be28-bf1cf428e627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:09.456178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b273e-cba0-4b76-b066-331cbb35f442 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:09.489237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3e4a4-db41-4935-aa0d-70c16e955abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:09.490030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e4a4-db41-4935-aa0d-70c16e955abd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.490342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e4a4-db41-4935-aa0d-70c16e955abd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.490620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3e4a4-db41-4935-aa0d-70c16e955abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.498631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 325/634] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:09.499965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb5c7-f3d1-40d9-807a-b616be827eb2 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.500281 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb5c7-f3d1-40d9-807a-b616be827eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.500563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bb5c7-f3d1-40d9-807a-b616be827eb2 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.501835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 326/635] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:09.502540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bb5c7-f3d1-40d9-807a-b616be827eb2 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:09.512777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3e4a4-db41-4935-aa0d-70c16e955abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:09.514329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d3e4a4-db41-4935-aa0d-70c16e955abd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-83d3e4a4-db41-4935-aa0d-70c16e955abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:09.532639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:09.533723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:09.534971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:09.534971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:09.534971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:09.534971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:09.534971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 310/636] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:09.535266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3e4a4-db41-4935-aa0d-70c16e955abd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:09.620443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:09.637924 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bb5c7-f3d1-40d9-807a-b616be827eb2 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:09.667191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3e4a4-db41-4935-aa0d-70c16e955abd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:09.670322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:09.676524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0977639-e4b2-4dc3-9d0f-c7b5e84033f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:09.677431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0977639-e4b2-4dc3-9d0f-c7b5e84033f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.677715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0977639-e4b2-4dc3-9d0f-c7b5e84033f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.677993 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0977639-e4b2-4dc3-9d0f-c7b5e84033f9 None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/945586c90ac148b8880b9ad6409b02f5/roles/2fe302f59f134744aaac6a31934efeea` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.693253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0977639-e4b2-4dc3-9d0f-c7b5e84033f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=945586c90ac148b8880b9ad6409b02f5, role_id=2fe302f59f134744aaac6a31934efeea)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:09.694772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0977639-e4b2-4dc3-9d0f-c7b5e84033f9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:09.707614 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 327/637] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:00:09 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/945586c90ac148b8880b9ad6409b02f5/roles/2fe302f59f134744aaac6a31934efeea => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:00:09.709126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def2fe0-c2cf-49e1-b614-72c28a5a76e0 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.709580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def2fe0-c2cf-49e1-b614-72c28a5a76e0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.709859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def2fe0-c2cf-49e1-b614-72c28a5a76e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.720722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307a1a5-2670-4dbd-8873-3d184349a432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:09.721554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307a1a5-2670-4dbd-8873-3d184349a432 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.721840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307a1a5-2670-4dbd-8873-3d184349a432 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.722120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307a1a5-2670-4dbd-8873-3d184349a432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.734988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307a1a5-2670-4dbd-8873-3d184349a432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:09.736525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307a1a5-2670-4dbd-8873-3d184349a432 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:09.737057 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-3def2fe0-c2cf-49e1-b614-72c28a5a76e0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:09.738351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3def2fe0-c2cf-49e1-b614-72c28a5a76e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9307a1a5-2670-4dbd-8873-3d184349a432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:09.765602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:09.766764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:09.767666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:09.767666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:09.767666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:09.767666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:09.774645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 311/638] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:09.774645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307a1a5-2670-4dbd-8873-3d184349a432 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:09.834525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 328/639] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:09.835350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def2fe0-c2cf-49e1-b614-72c28a5a76e0 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:09.909266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307a1a5-2670-4dbd-8873-3d184349a432 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:09.935098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:09.949978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8d31-cd24-4dfb-8754-6104084688ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:09.950817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8d31-cd24-4dfb-8754-6104084688ee None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:09.951108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8d31-cd24-4dfb-8754-6104084688ee None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:09.951372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c8d31-cd24-4dfb-8754-6104084688ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:09.962569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c8d31-cd24-4dfb-8754-6104084688ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6f4c8d31-cd24-4dfb-8754-6104084688ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:09.970331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:09.971585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 312/640] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:09.972439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8d31-cd24-4dfb-8754-6104084688ee None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:09.983246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def2fe0-c2cf-49e1-b614-72c28a5a76e0 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:09.997461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:10.020647 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50457545-1865-47ad-9bc0-6846326756ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:10.021324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50457545-1865-47ad-9bc0-6846326756ef None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:10.021613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50457545-1865-47ad-9bc0-6846326756ef None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:10.021892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50457545-1865-47ad-9bc0-6846326756ef None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:10.022797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50457545-1865-47ad-9bc0-6846326756ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:10.022977 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50457545-1865-47ad-9bc0-6846326756ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:10.024370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50457545-1865-47ad-9bc0-6846326756ef None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:10.037132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 329/641] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:10.039149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50457545-1865-47ad-9bc0-6846326756ef None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:10.086723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c8d31-cd24-4dfb-8754-6104084688ee None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:10.157227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50457545-1865-47ad-9bc0-6846326756ef None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:10.160665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3767cc-51ca-4767-a58b-855a6d264f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:10.161278 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3767cc-51ca-4767-a58b-855a6d264f9c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:10.161560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3767cc-51ca-4767-a58b-855a6d264f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:10.161833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3767cc-51ca-4767-a58b-855a6d264f9c None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:10.162586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3767cc-51ca-4767-a58b-855a6d264f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:10.162893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3767cc-51ca-4767-a58b-855a6d264f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:10.164660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3767cc-51ca-4767-a58b-855a6d264f9c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:10.181812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 313/642] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:10.181812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3767cc-51ca-4767-a58b-855a6d264f9c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:10.223979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:10.252734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccc428-0f9a-4ac1-8fb4-f24c406511e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:10.253806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccc428-0f9a-4ac1-8fb4-f24c406511e9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:10.254517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccc428-0f9a-4ac1-8fb4-f24c406511e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:10.254808 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccc428-0f9a-4ac1-8fb4-f24c406511e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:10.270440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccc428-0f9a-4ac1-8fb4-f24c406511e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:10.274366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8cccc428-0f9a-4ac1-8fb4-f24c406511e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:10.282118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:10.283255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:10.284115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:10.292274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 330/643] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:10.293235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccc428-0f9a-4ac1-8fb4-f24c406511e9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:10.308856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3767cc-51ca-4767-a58b-855a6d264f9c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:10.346802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa4001-8b9c-49fe-a9ea-2596b75c9adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:10.347572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa4001-8b9c-49fe-a9ea-2596b75c9adf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:10.347772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa4001-8b9c-49fe-a9ea-2596b75c9adf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:10.348034 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa4001-8b9c-49fe-a9ea-2596b75c9adf None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:10.348788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa4001-8b9c-49fe-a9ea-2596b75c9adf None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:10.349095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa4001-8b9c-49fe-a9ea-2596b75c9adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:10.350556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa4001-8b9c-49fe-a9ea-2596b75c9adf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:10.371129 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 314/644] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:10.371129 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa4001-8b9c-49fe-a9ea-2596b75c9adf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:10.422385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccc428-0f9a-4ac1-8fb4-f24c406511e9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:10.465781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83cb81-b51d-4488-9f71-417299de5eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:10.466892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83cb81-b51d-4488-9f71-417299de5eba None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:10.467349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83cb81-b51d-4488-9f71-417299de5eba None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:10.467810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83cb81-b51d-4488-9f71-417299de5eba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:10.479054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83cb81-b51d-4488-9f71-417299de5eba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:10.480720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb83cb81-b51d-4488-9f71-417299de5eba None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-bb83cb81-b51d-4488-9f71-417299de5eba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:10.498888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:10.499968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:10.501063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:10.501063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:10.501063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:10.501063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:10.501063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:10.501063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:10.501063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:10.501063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:10.501063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:00:10.501063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:10.503513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 331/645] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:10.504603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83cb81-b51d-4488-9f71-417299de5eba None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:10.509687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa4001-8b9c-49fe-a9ea-2596b75c9adf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:10.548183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793deca0-a7ad-4734-b3c8-11c3113d3c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:10.548978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793deca0-a7ad-4734-b3c8-11c3113d3c31 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:10.549260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793deca0-a7ad-4734-b3c8-11c3113d3c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:10.549535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793deca0-a7ad-4734-b3c8-11c3113d3c31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:10.557478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793deca0-a7ad-4734-b3c8-11c3113d3c31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:10.558958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793deca0-a7ad-4734-b3c8-11c3113d3c31 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:10.561179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:10.564743 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-793deca0-a7ad-4734-b3c8-11c3113d3c31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:10.577495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:10.578597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:10.579496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:10.579496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:10.579496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:10.579496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:10.579496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:10.579496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:10.579496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:10.579496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:10.579496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 315/646] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:10.579986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793deca0-a7ad-4734-b3c8-11c3113d3c31 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:10.634427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83cb81-b51d-4488-9f71-417299de5eba None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:10.669022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e05e2-e2ba-43c3-b390-3abd2c789301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:10.669708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e05e2-e2ba-43c3-b390-3abd2c789301 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:10.670002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e05e2-e2ba-43c3-b390-3abd2c789301 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:10.670320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e05e2-e2ba-43c3-b390-3abd2c789301 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:10.671090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e05e2-e2ba-43c3-b390-3abd2c789301 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:10.671409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e05e2-e2ba-43c3-b390-3abd2c789301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:10.672840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e05e2-e2ba-43c3-b390-3abd2c789301 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:10.681323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 332/647] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:10.682139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e05e2-e2ba-43c3-b390-3abd2c789301 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:10.696218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793deca0-a7ad-4734-b3c8-11c3113d3c31 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:10.734467 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981d86d-b1fd-47eb-bd04-88f6da2f6528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:10.735613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d86d-b1fd-47eb-bd04-88f6da2f6528 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:10.736040 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d86d-b1fd-47eb-bd04-88f6da2f6528 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:10.736478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d86d-b1fd-47eb-bd04-88f6da2f6528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:10.747778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981d86d-b1fd-47eb-bd04-88f6da2f6528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:10.749401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981d86d-b1fd-47eb-bd04-88f6da2f6528 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d981d86d-b1fd-47eb-bd04-88f6da2f6528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:10.768230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:10.769324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:10.770686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:10.770686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:10.770686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:10.770686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:10.772567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 316/648] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:10.774170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981d86d-b1fd-47eb-bd04-88f6da2f6528 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:10.791067 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e05e2-e2ba-43c3-b390-3abd2c789301 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:10.802419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:10.827746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0ab5d-2c9a-4fbc-8571-b0c4006f510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:10.828490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ab5d-2c9a-4fbc-8571-b0c4006f510f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:10.828781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ab5d-2c9a-4fbc-8571-b0c4006f510f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:10.829068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ab5d-2c9a-4fbc-8571-b0c4006f510f None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:10.829958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0ab5d-2c9a-4fbc-8571-b0c4006f510f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:10.830315 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0ab5d-2c9a-4fbc-8571-b0c4006f510f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:10.831763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0ab5d-2c9a-4fbc-8571-b0c4006f510f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:10.832911 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:10.850505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 333/649] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 11 14:00:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:10.855018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0ab5d-2c9a-4fbc-8571-b0c4006f510f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:10.900182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981d86d-b1fd-47eb-bd04-88f6da2f6528 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:10.937363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5d8cf-2da8-4292-9941-6ea1f96bcfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:10.937947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d8cf-2da8-4292-9941-6ea1f96bcfdf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:10.938270 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d8cf-2da8-4292-9941-6ea1f96bcfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:10.938547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5d8cf-2da8-4292-9941-6ea1f96bcfdf None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:10.939340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5d8cf-2da8-4292-9941-6ea1f96bcfdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:10.939647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5d8cf-2da8-4292-9941-6ea1f96bcfdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:10.941077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5d8cf-2da8-4292-9941-6ea1f96bcfdf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:10.953740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 317/650] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:10.954514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5d8cf-2da8-4292-9941-6ea1f96bcfdf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:10.988956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0ab5d-2c9a-4fbc-8571-b0c4006f510f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:11.030605 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195abcc5-5e33-4a56-b304-db243dea4f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:11.031405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195abcc5-5e33-4a56-b304-db243dea4f5a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:11.031692 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195abcc5-5e33-4a56-b304-db243dea4f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:11.031971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195abcc5-5e33-4a56-b304-db243dea4f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:11.043370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195abcc5-5e33-4a56-b304-db243dea4f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:11.044850 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195abcc5-5e33-4a56-b304-db243dea4f5a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-195abcc5-5e33-4a56-b304-db243dea4f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:11.064571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:11.065491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:11.066686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:11.066686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:11.066686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:11.066686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:11.066686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 334/651] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:11.066686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195abcc5-5e33-4a56-b304-db243dea4f5a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:11.072665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5d8cf-2da8-4292-9941-6ea1f96bcfdf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:11.084342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:11.095222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:11.109773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df999d-69ef-4794-b01e-e3ef7c76df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:11.110483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df999d-69ef-4794-b01e-e3ef7c76df56 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:11.110766 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df999d-69ef-4794-b01e-e3ef7c76df56 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:11.111038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df999d-69ef-4794-b01e-e3ef7c76df56 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:11.111760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df999d-69ef-4794-b01e-e3ef7c76df56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:11.112069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df999d-69ef-4794-b01e-e3ef7c76df56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:11.113435 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df999d-69ef-4794-b01e-e3ef7c76df56 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:11.125371 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 318/652] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:11.126083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df999d-69ef-4794-b01e-e3ef7c76df56 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:11.185047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195abcc5-5e33-4a56-b304-db243dea4f5a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:11.229691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0f076-66f2-43b4-83cf-c50b2898f735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:11.230374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0f076-66f2-43b4-83cf-c50b2898f735 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:11.230661 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0f076-66f2-43b4-83cf-c50b2898f735 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:11.230940 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0f076-66f2-43b4-83cf-c50b2898f735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:11.250438 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df999d-69ef-4794-b01e-e3ef7c76df56 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:11.287538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fd649-5252-461c-9b6f-9985d1f46390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:11.288202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fd649-5252-461c-9b6f-9985d1f46390 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:11.288571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fd649-5252-461c-9b6f-9985d1f46390 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:11.288871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fd649-5252-461c-9b6f-9985d1f46390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:11.289719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fd649-5252-461c-9b6f-9985d1f46390 None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=38a31386700941c9b103720a64bac405) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:11.290050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fd649-5252-461c-9b6f-9985d1f46390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:11.291499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fd649-5252-461c-9b6f-9985d1f46390 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:11.297430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 319/653] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:11 2022] GET /identity/v3/role_assignments?user.id=38a31386700941c9b103720a64bac405&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:11.298239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fd649-5252-461c-9b6f-9985d1f46390 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:11.316107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0f076-66f2-43b4-83cf-c50b2898f735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:11.318099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0f076-66f2-43b4-83cf-c50b2898f735 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:11.343537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:11.344405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:11.423170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fd649-5252-461c-9b6f-9985d1f46390 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:11.462398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 335/654] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:00:11.463864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0f076-66f2-43b4-83cf-c50b2898f735 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:11.468397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3ab26-ec86-44bd-9a06-a94e790070dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:11.468781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3ab26-ec86-44bd-9a06-a94e790070dc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:11.469067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3ab26-ec86-44bd-9a06-a94e790070dc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:11.469406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3ab26-ec86-44bd-9a06-a94e790070dc None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:11.470179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3ab26-ec86-44bd-9a06-a94e790070dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:11.470542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3ab26-ec86-44bd-9a06-a94e790070dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:11.472031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3ab26-ec86-44bd-9a06-a94e790070dc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:11.488635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 320/655] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:11.489707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3ab26-ec86-44bd-9a06-a94e790070dc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:11.596328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0f076-66f2-43b4-83cf-c50b2898f735 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:11.608396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:11.620460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:11.624787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3ab26-ec86-44bd-9a06-a94e790070dc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:11.643978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af17f94-da60-4a33-9c7e-42f3c225183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:11.646226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17f94-da60-4a33-9c7e-42f3c225183c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:11.646733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17f94-da60-4a33-9c7e-42f3c225183c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:11.647505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17f94-da60-4a33-9c7e-42f3c225183c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:11.658947 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af17f94-da60-4a33-9c7e-42f3c225183c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:11.661813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af17f94-da60-4a33-9c7e-42f3c225183c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:11.669816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5243-f99e-4c71-bc20-f8ff41a568ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:11.670651 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5243-f99e-4c71-bc20-f8ff41a568ab None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:11.671068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5243-f99e-4c71-bc20-f8ff41a568ab None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:11.671364 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b5243-f99e-4c71-bc20-f8ff41a568ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-5af17f94-da60-4a33-9c7e-42f3c225183c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:11.682394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:11.683374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:11.684353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:11.684353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:11.684353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:11.684353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:11.684353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:11.684353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:11.684353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:11.684353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:11.684353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 11 14:00:11.684353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:11.684918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b5243-f99e-4c71-bc20-f8ff41a568ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:11.684918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b5243-f99e-4c71-bc20-f8ff41a568ab None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:11.687958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 336/656] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:11.689068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af17f94-da60-4a33-9c7e-42f3c225183c None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-cb0b5243-f99e-4c71-bc20-f8ff41a568ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:11.706915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:11.707906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:11.708809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:11.708809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:11.708809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:11.708809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:11.710245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 321/657] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:11.711827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5243-f99e-4c71-bc20-f8ff41a568ab None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:11.813664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af17f94-da60-4a33-9c7e-42f3c225183c None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:11.823485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b5243-f99e-4c71-bc20-f8ff41a568ab None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:11.853482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c5949-c138-4e81-b465-3724d16d225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:11.854328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c5949-c138-4e81-b465-3724d16d225a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:11.854617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c5949-c138-4e81-b465-3724d16d225a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:11.854895 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c5949-c138-4e81-b465-3724d16d225a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:11.861389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7cb5e-1e58-4d0d-bfea-561c450e765d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:11.862513 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7cb5e-1e58-4d0d-bfea-561c450e765d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:11.863159 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c5949-c138-4e81-b465-3724d16d225a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:11.863384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7cb5e-1e58-4d0d-bfea-561c450e765d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:11.863871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7cb5e-1e58-4d0d-bfea-561c450e765d None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:11.864627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c5949-c138-4e81-b465-3724d16d225a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:11.865183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7cb5e-1e58-4d0d-bfea-561c450e765d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:11.865731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7cb5e-1e58-4d0d-bfea-561c450e765d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:11.867484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7cb5e-1e58-4d0d-bfea-561c450e765d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8a1c5949-c138-4e81-b465-3724d16d225a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:11.879972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:11.881103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:11.883291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:11.883291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:11.883291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:11.883291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:11.883291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:11.883291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:11.883291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:11.883291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:11.883291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 11 14:00:11.883291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:11.886144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 337/658] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:11.887156 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c5949-c138-4e81-b465-3724d16d225a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:11.888600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 322/659] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Jul 11 14:00:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:11.890120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d457-3249-4667-ab1b-102f252dfc67 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:11.890446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d457-3249-4667-ab1b-102f252dfc67 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:11.890727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d457-3249-4667-ab1b-102f252dfc67 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:11.894354 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 323/660] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:11.894354 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d457-3249-4667-ab1b-102f252dfc67 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:11.896826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:11.940185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:12.013284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c5949-c138-4e81-b465-3724d16d225a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:12.014184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004d457-3249-4667-ab1b-102f252dfc67 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:12.051201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f1554-52ab-477b-ab0c-fa46951b6493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:12.051997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f1554-52ab-477b-ab0c-fa46951b6493 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:12.052288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f1554-52ab-477b-ab0c-fa46951b6493 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:12.052573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f1554-52ab-477b-ab0c-fa46951b6493 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:12.053340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f1554-52ab-477b-ab0c-fa46951b6493 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:12.053655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f1554-52ab-477b-ab0c-fa46951b6493 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:12.053875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ff510-804c-46be-be83-beea8fd9d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:12.054827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff510-804c-46be-be83-beea8fd9d523 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:12.055269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f1554-52ab-477b-ab0c-fa46951b6493 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:12.055373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff510-804c-46be-be83-beea8fd9d523 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:12.055605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff510-804c-46be-be83-beea8fd9d523 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:12.056450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ff510-804c-46be-be83-beea8fd9d523 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:12.056755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ff510-804c-46be-be83-beea8fd9d523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:12.058499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ff510-804c-46be-be83-beea8fd9d523 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:12.073747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 338/661] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:12.073747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f1554-52ab-477b-ab0c-fa46951b6493 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:12.078140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 324/662] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Jul 11 14:00:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:12.082622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8224bd-1649-4a27-9331-a752381d6dac None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:12.082622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8224bd-1649-4a27-9331-a752381d6dac None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:12.082622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8224bd-1649-4a27-9331-a752381d6dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:12.098486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-af8224bd-1649-4a27-9331-a752381d6dac None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:12.099673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-af8224bd-1649-4a27-9331-a752381d6dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:12.162028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:12.178654 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 325/663] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:12.178654 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8224bd-1649-4a27-9331-a752381d6dac None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:12.191096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:12.196726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f1554-52ab-477b-ab0c-fa46951b6493 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:12.237087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9da04-e0f0-4c56-b367-78debbc217a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:12.237900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9da04-e0f0-4c56-b367-78debbc217a4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:12.238339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9da04-e0f0-4c56-b367-78debbc217a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:12.238744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9da04-e0f0-4c56-b367-78debbc217a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:12.300053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8224bd-1649-4a27-9331-a752381d6dac None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:12.318244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9da04-e0f0-4c56-b367-78debbc217a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:12.320108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9da04-e0f0-4c56-b367-78debbc217a4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:12.338536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb10b91-81a8-4e00-ba5c-6c120c157068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:12.339261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb10b91-81a8-4e00-ba5c-6c120c157068 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:12.339543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb10b91-81a8-4e00-ba5c-6c120c157068 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:12.339814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb10b91-81a8-4e00-ba5c-6c120c157068 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:12.346832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb10b91-81a8-4e00-ba5c-6c120c157068 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:12.348418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb10b91-81a8-4e00-ba5c-6c120c157068 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-bbb10b91-81a8-4e00-ba5c-6c120c157068 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:12.362509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:12.363425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:12.364312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:12.364312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:12.364312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:12.364312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:12.364312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:12.364312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:12.364312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:12.364312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:12.364312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 326/664] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:12.365209 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb10b91-81a8-4e00-ba5c-6c120c157068 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:12.424272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:12.427753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:12.433137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 339/665] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:00:12.434396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9da04-e0f0-4c56-b367-78debbc217a4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:12.480806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb10b91-81a8-4e00-ba5c-6c120c157068 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:12.517362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24e34f-e70b-49f4-a70b-98d3a1c259c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:12.518301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24e34f-e70b-49f4-a70b-98d3a1c259c7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:12.518301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24e34f-e70b-49f4-a70b-98d3a1c259c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:12.518588 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24e34f-e70b-49f4-a70b-98d3a1c259c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:12.547006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9da04-e0f0-4c56-b367-78debbc217a4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:12.586981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3932e-989c-479c-983a-a7cfe9578c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:12.587801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3932e-989c-479c-983a-a7cfe9578c51 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:12.588091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3932e-989c-479c-983a-a7cfe9578c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:12.588370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3932e-989c-479c-983a-a7cfe9578c51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:12.598343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24e34f-e70b-49f4-a70b-98d3a1c259c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:12.599029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3932e-989c-479c-983a-a7cfe9578c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:12.599881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24e34f-e70b-49f4-a70b-98d3a1c259c7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-c5d3932e-989c-479c-983a-a7cfe9578c51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:12.607297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:12.610380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 340/666] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:12.611502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3932e-989c-479c-983a-a7cfe9578c51 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:12.662295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:12.680140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:12.717817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 327/667] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:00:12.723092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24e34f-e70b-49f4-a70b-98d3a1c259c7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:12.732008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3932e-989c-479c-983a-a7cfe9578c51 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:12.768853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190fa7e-fe1e-49db-b134-562e45b6d905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:12.769510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190fa7e-fe1e-49db-b134-562e45b6d905 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:12.769795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190fa7e-fe1e-49db-b134-562e45b6d905 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:12.770069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190fa7e-fe1e-49db-b134-562e45b6d905 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:12.771149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190fa7e-fe1e-49db-b134-562e45b6d905 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:12.771462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190fa7e-fe1e-49db-b134-562e45b6d905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:12.772898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190fa7e-fe1e-49db-b134-562e45b6d905 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:12.786493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 341/668] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:12.787571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190fa7e-fe1e-49db-b134-562e45b6d905 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:12.835260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24e34f-e70b-49f4-a70b-98d3a1c259c7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:12.873779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b52b5-6008-4861-b307-b161c7bae8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:12.874626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b52b5-6008-4861-b307-b161c7bae8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:12.874907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b52b5-6008-4861-b307-b161c7bae8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:12.875184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b52b5-6008-4861-b307-b161c7bae8f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:12.893511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b52b5-6008-4861-b307-b161c7bae8f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:12.895059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b52b5-6008-4861-b307-b161c7bae8f9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:12.896998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190fa7e-fe1e-49db-b134-562e45b6d905 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c68b52b5-6008-4861-b307-b161c7bae8f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:12.916077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:12.917227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:12.918370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:12.918370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:12.918370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:12.918370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:12.922634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 328/669] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:12.923167 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b52b5-6008-4861-b307-b161c7bae8f9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:12.926329 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:12.927389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:12.943087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529bc74-a665-4e62-8cd5-f69f79af69cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:12.943871 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529bc74-a665-4e62-8cd5-f69f79af69cd None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:12.944223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529bc74-a665-4e62-8cd5-f69f79af69cd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:12.944565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529bc74-a665-4e62-8cd5-f69f79af69cd None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:12.945417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529bc74-a665-4e62-8cd5-f69f79af69cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:12.945785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529bc74-a665-4e62-8cd5-f69f79af69cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:12.947270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529bc74-a665-4e62-8cd5-f69f79af69cd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:12.961301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 342/670] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:12.961301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529bc74-a665-4e62-8cd5-f69f79af69cd None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:13.033005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b52b5-6008-4861-b307-b161c7bae8f9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:13.068602 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529bc74-a665-4e62-8cd5-f69f79af69cd None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:13.071177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6417575-5aa4-4048-b077-d64873d84066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:13.071979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6417575-5aa4-4048-b077-d64873d84066 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:13.072266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6417575-5aa4-4048-b077-d64873d84066 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:13.072540 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6417575-5aa4-4048-b077-d64873d84066 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:13.083287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6417575-5aa4-4048-b077-d64873d84066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:13.084748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6417575-5aa4-4048-b077-d64873d84066 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c6417575-5aa4-4048-b077-d64873d84066 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:13.103179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:13.104261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:13.105195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:13.105195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:13.105195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:13.105195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:13.105195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 329/671] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:13.105622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6417575-5aa4-4048-b077-d64873d84066 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:13.111502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a32f7-e983-439f-8d19-82bdf93c4459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:13.112183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a32f7-e983-439f-8d19-82bdf93c4459 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:13.112469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a32f7-e983-439f-8d19-82bdf93c4459 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:13.112745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a32f7-e983-439f-8d19-82bdf93c4459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:13.113600 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a32f7-e983-439f-8d19-82bdf93c4459 None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=a5cf559c8a69483ca7625f37d5931439) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:13.113913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a32f7-e983-439f-8d19-82bdf93c4459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:13.115379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a32f7-e983-439f-8d19-82bdf93c4459 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:13.130717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 343/672] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:12 2022] GET /identity/v3/role_assignments?user.id=a5cf559c8a69483ca7625f37d5931439&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:13.130717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a32f7-e983-439f-8d19-82bdf93c4459 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:13.187264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:13.195225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:13.250847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6417575-5aa4-4048-b077-d64873d84066 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:13.275562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a32f7-e983-439f-8d19-82bdf93c4459 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:13.292496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99698ef2-8313-469e-b272-6781ff9c2bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:13.293472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698ef2-8313-469e-b272-6781ff9c2bac None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:13.294032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698ef2-8313-469e-b272-6781ff9c2bac None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:13.294527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99698ef2-8313-469e-b272-6781ff9c2bac None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:13.295496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99698ef2-8313-469e-b272-6781ff9c2bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:13.295979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99698ef2-8313-469e-b272-6781ff9c2bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:13.297620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99698ef2-8313-469e-b272-6781ff9c2bac None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:13.310979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 330/673] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:13.316112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99698ef2-8313-469e-b272-6781ff9c2bac None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:13.320488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b59cf-2428-4fa0-bcfa-7468218648e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:13.321462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b59cf-2428-4fa0-bcfa-7468218648e9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:13.321757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b59cf-2428-4fa0-bcfa-7468218648e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:13.322042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b59cf-2428-4fa0-bcfa-7468218648e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:13.336680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b59cf-2428-4fa0-bcfa-7468218648e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:13.338178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b59cf-2428-4fa0-bcfa-7468218648e9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-426b59cf-2428-4fa0-bcfa-7468218648e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:13.358002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:13.359115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:13.360203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:13.360203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:13.360203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:13.360203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:13.360203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 344/674] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:13.360557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b59cf-2428-4fa0-bcfa-7468218648e9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:13.461604 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99698ef2-8313-469e-b272-6781ff9c2bac None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:13.475308 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:13.480449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b59cf-2428-4fa0-bcfa-7468218648e9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:13.485292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:13.508623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a4df3-2b37-4f84-8b31-f551b36a2323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:13.509316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a4df3-2b37-4f84-8b31-f551b36a2323 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:13.509616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a4df3-2b37-4f84-8b31-f551b36a2323 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:13.510179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a4df3-2b37-4f84-8b31-f551b36a2323 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:13.510928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a4df3-2b37-4f84-8b31-f551b36a2323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:13.511243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a4df3-2b37-4f84-8b31-f551b36a2323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:13.513304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a4df3-2b37-4f84-8b31-f551b36a2323 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:13.521236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c1dbc-5b61-40e8-9389-538e21834e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:13.522193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c1dbc-5b61-40e8-9389-538e21834e0d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:13.522479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c1dbc-5b61-40e8-9389-538e21834e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:13.522756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c1dbc-5b61-40e8-9389-538e21834e0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:13.528121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 331/675] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:13.528950 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a4df3-2b37-4f84-8b31-f551b36a2323 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:13.533619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c1dbc-5b61-40e8-9389-538e21834e0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:13.535120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c1dbc-5b61-40e8-9389-538e21834e0d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-610c1dbc-5b61-40e8-9389-538e21834e0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:13.551335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:13.552725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:13.553634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:13.553634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:13.553634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:13.553634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:13.553634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:13.553634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:13.553634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:13.553634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:13.558052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 345/676] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:13.559364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38099f6-cb21-4146-8621-bf3953c75a8b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:13.559653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38099f6-cb21-4146-8621-bf3953c75a8b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:13.559933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38099f6-cb21-4146-8621-bf3953c75a8b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:13.562332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 346/677] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:13.562332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38099f6-cb21-4146-8621-bf3953c75a8b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:13.641454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a4df3-2b37-4f84-8b31-f551b36a2323 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:13.679931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bd075-eb4c-4e40-b3a6-db1bd98f17f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:13.680601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd075-eb4c-4e40-b3a6-db1bd98f17f8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:13.680881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd075-eb4c-4e40-b3a6-db1bd98f17f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:13.681156 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd075-eb4c-4e40-b3a6-db1bd98f17f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:13.681877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bd075-eb4c-4e40-b3a6-db1bd98f17f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:13.682202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bd075-eb4c-4e40-b3a6-db1bd98f17f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:13.682661 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38099f6-cb21-4146-8621-bf3953c75a8b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:13.683586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bd075-eb4c-4e40-b3a6-db1bd98f17f8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:13.698098 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 332/678] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:13.703133 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bd075-eb4c-4e40-b3a6-db1bd98f17f8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:13.728092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86badc5e-e087-4c00-8d9f-462080dc7aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:13.728829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86badc5e-e087-4c00-8d9f-462080dc7aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:13.729116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86badc5e-e087-4c00-8d9f-462080dc7aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:13.729394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86badc5e-e087-4c00-8d9f-462080dc7aa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:13.737757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86badc5e-e087-4c00-8d9f-462080dc7aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:13.739316 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86badc5e-e087-4c00-8d9f-462080dc7aa4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:13.743592 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-86badc5e-e087-4c00-8d9f-462080dc7aa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:13.754494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:13.755615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:13.756801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:13.756801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:13.756801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:13.756801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:13.756801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:13.756801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:13.756801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:13.756801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:13.756801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 347/679] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:13.759616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57a00-f197-449b-9cbe-e6aae5012a6d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:13.760390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57a00-f197-449b-9cbe-e6aae5012a6d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:13.760677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf57a00-f197-449b-9cbe-e6aae5012a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:13.778979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-8cf57a00-f197-449b-9cbe-e6aae5012a6d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:13.780190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8cf57a00-f197-449b-9cbe-e6aae5012a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:13.795114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:13.824257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bd075-eb4c-4e40-b3a6-db1bd98f17f8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:13.854226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 348/680] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:13.854226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf57a00-f197-449b-9cbe-e6aae5012a6d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:13.871925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a2fc-5cfe-4729-87da-9b8b08ae6cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:13.873142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a2fc-5cfe-4729-87da-9b8b08ae6cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:13.873622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a2fc-5cfe-4729-87da-9b8b08ae6cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:13.874522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a2fc-5cfe-4729-87da-9b8b08ae6cc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:13.875748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a2fc-5cfe-4729-87da-9b8b08ae6cc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:13.876221 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a2fc-5cfe-4729-87da-9b8b08ae6cc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:13.878437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a2fc-5cfe-4729-87da-9b8b08ae6cc0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:13.894484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 333/681] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:13.896891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a2fc-5cfe-4729-87da-9b8b08ae6cc0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:13.969056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf57a00-f197-449b-9cbe-e6aae5012a6d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:14.001575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:14.009384 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe2577-00b6-4171-acf1-52034aa7d879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:14.009546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a2fc-5cfe-4729-87da-9b8b08ae6cc0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:14.010218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe2577-00b6-4171-acf1-52034aa7d879 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:14.010509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe2577-00b6-4171-acf1-52034aa7d879 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:14.010784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe2577-00b6-4171-acf1-52034aa7d879 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:14.018294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe2577-00b6-4171-acf1-52034aa7d879 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:14.019746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe2577-00b6-4171-acf1-52034aa7d879 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-5ebe2577-00b6-4171-acf1-52034aa7d879 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:14.034727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:14.035684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 349/682] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:14.036702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe2577-00b6-4171-acf1-52034aa7d879 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:14.049463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:14.052369 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1273f5-da8a-4745-b63f-6cd857e1411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:14.053167 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1273f5-da8a-4745-b63f-6cd857e1411b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:14.053456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1273f5-da8a-4745-b63f-6cd857e1411b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:14.053728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1273f5-da8a-4745-b63f-6cd857e1411b None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:14.055101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1273f5-da8a-4745-b63f-6cd857e1411b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:14.055467 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1273f5-da8a-4745-b63f-6cd857e1411b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:14.056856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1273f5-da8a-4745-b63f-6cd857e1411b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:14.070568 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 334/683] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:14.071350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1273f5-da8a-4745-b63f-6cd857e1411b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:14.153790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe2577-00b6-4171-acf1-52034aa7d879 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:14.181277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1273f5-da8a-4745-b63f-6cd857e1411b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:14.190173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb58d88-a4db-490d-94b3-a0c9bbd6b8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:14.191068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58d88-a4db-490d-94b3-a0c9bbd6b8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:14.191440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58d88-a4db-490d-94b3-a0c9bbd6b8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:14.191787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58d88-a4db-490d-94b3-a0c9bbd6b8b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:14.206998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb58d88-a4db-490d-94b3-a0c9bbd6b8b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-1cb58d88-a4db-490d-94b3-a0c9bbd6b8b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:14.214941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:14.215873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:14.216716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 350/684] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:14.217419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb58d88-a4db-490d-94b3-a0c9bbd6b8b8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:14.230462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb086e7a-3e26-4cf8-a26a-4158e9d43653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:14.231134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb086e7a-3e26-4cf8-a26a-4158e9d43653 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:14.231422 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb086e7a-3e26-4cf8-a26a-4158e9d43653 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:14.231706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb086e7a-3e26-4cf8-a26a-4158e9d43653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:14.232553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb086e7a-3e26-4cf8-a26a-4158e9d43653 None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=690a93a4d6ed4666a607b05a8c2b6549) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:14.232870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb086e7a-3e26-4cf8-a26a-4158e9d43653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:14.234344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb086e7a-3e26-4cf8-a26a-4158e9d43653 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:14.240419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 335/685] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:14 2022] GET /identity/v3/role_assignments?user.id=690a93a4d6ed4666a607b05a8c2b6549&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:14.241215 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb086e7a-3e26-4cf8-a26a-4158e9d43653 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:14.279066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:14.307125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:14.348648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb58d88-a4db-490d-94b3-a0c9bbd6b8b8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:14.387835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a71643-50a7-4424-bef0-1bc06b654fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:14.388709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a71643-50a7-4424-bef0-1bc06b654fcd None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:14.389080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a71643-50a7-4424-bef0-1bc06b654fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:14.389426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a71643-50a7-4424-bef0-1bc06b654fcd None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:14.393816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a71643-50a7-4424-bef0-1bc06b654fcd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:14.393816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a71643-50a7-4424-bef0-1bc06b654fcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:14.393816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a71643-50a7-4424-bef0-1bc06b654fcd None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:14.398686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb086e7a-3e26-4cf8-a26a-4158e9d43653 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:14.421028 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 351/686] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Jul 11 14:00:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:14.421976 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a71643-50a7-4424-bef0-1bc06b654fcd None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:14.444984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed3aad-c1fd-429e-9f66-248a58b94dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:14.446232 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed3aad-c1fd-429e-9f66-248a58b94dde None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:14.446529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed3aad-c1fd-429e-9f66-248a58b94dde None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:14.446810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed3aad-c1fd-429e-9f66-248a58b94dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:14.447961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed3aad-c1fd-429e-9f66-248a58b94dde None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=4426582f945e4c90bf8debd2ecbd9769) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:14.448283 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed3aad-c1fd-429e-9f66-248a58b94dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:14.450109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed3aad-c1fd-429e-9f66-248a58b94dde None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:14.457260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 336/687] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:14 2022] GET /identity/v3/role_assignments?user.id=4426582f945e4c90bf8debd2ecbd9769&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:14.458114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed3aad-c1fd-429e-9f66-248a58b94dde None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:14.560447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a71643-50a7-4424-bef0-1bc06b654fcd None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:14.573863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:14.594428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed3aad-c1fd-429e-9f66-248a58b94dde None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:14.603683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:14.616359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebdbc6-19a1-4988-a1d1-f0f4ba97d24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:14.618250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebdbc6-19a1-4988-a1d1-f0f4ba97d24b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:14.618564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebdbc6-19a1-4988-a1d1-f0f4ba97d24b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:14.618853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebdbc6-19a1-4988-a1d1-f0f4ba97d24b None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:14.619834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebdbc6-19a1-4988-a1d1-f0f4ba97d24b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:14.620273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebdbc6-19a1-4988-a1d1-f0f4ba97d24b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:14.621702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebdbc6-19a1-4988-a1d1-f0f4ba97d24b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:14.634441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 352/688] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:14.641416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebdbc6-19a1-4988-a1d1-f0f4ba97d24b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:14.655702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da989ed7-24ef-45df-a388-b09e90a88d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:14.656735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da989ed7-24ef-45df-a388-b09e90a88d0a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:14.657230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da989ed7-24ef-45df-a388-b09e90a88d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:14.657733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da989ed7-24ef-45df-a388-b09e90a88d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:14.753403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da989ed7-24ef-45df-a388-b09e90a88d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:14.755495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da989ed7-24ef-45df-a388-b09e90a88d0a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:14.775714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebdbc6-19a1-4988-a1d1-f0f4ba97d24b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:14.824097 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9978-40b5-4943-85b7-9cece69276f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:14.825272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9978-40b5-4943-85b7-9cece69276f5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:14.825561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9978-40b5-4943-85b7-9cece69276f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:14.825979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c9978-40b5-4943-85b7-9cece69276f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:14.841111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c9978-40b5-4943-85b7-9cece69276f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:14.842890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c9978-40b5-4943-85b7-9cece69276f5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-fa5c9978-40b5-4943-85b7-9cece69276f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:14.876173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:14.877347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:14.878453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:14.878453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:14.878453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:14.878453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:14.880413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 353/689] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:14.885134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9978-40b5-4943-85b7-9cece69276f5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:14.885674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:14.904726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 337/690] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:00:14.909247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da989ed7-24ef-45df-a388-b09e90a88d0a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:14.978521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:15.053264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da989ed7-24ef-45df-a388-b09e90a88d0a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:15.092873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53e1be-2390-45e7-87bd-f62e89fe2445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:15.093763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e1be-2390-45e7-87bd-f62e89fe2445 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:15.094148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e1be-2390-45e7-87bd-f62e89fe2445 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:15.094551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e1be-2390-45e7-87bd-f62e89fe2445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:15.107317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53e1be-2390-45e7-87bd-f62e89fe2445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:15.109092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53e1be-2390-45e7-87bd-f62e89fe2445 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1a53e1be-2390-45e7-87bd-f62e89fe2445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:15.130408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:15.131539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:15.132630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:15.132630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:15.132630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:15.132630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:15.138201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 338/691] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:15.143689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53e1be-2390-45e7-87bd-f62e89fe2445 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:15.161533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c9978-40b5-4943-85b7-9cece69276f5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:15.209849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f31ad7-7cab-43cc-bb45-aa8f14a60193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:15.211584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f31ad7-7cab-43cc-bb45-aa8f14a60193 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:15.212150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f31ad7-7cab-43cc-bb45-aa8f14a60193 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:15.212608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f31ad7-7cab-43cc-bb45-aa8f14a60193 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:15.215928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f31ad7-7cab-43cc-bb45-aa8f14a60193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:15.216427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f31ad7-7cab-43cc-bb45-aa8f14a60193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:15.217991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f31ad7-7cab-43cc-bb45-aa8f14a60193 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:15.232029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 354/692] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:15.237468 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:15.238934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f31ad7-7cab-43cc-bb45-aa8f14a60193 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:15.345610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f31ad7-7cab-43cc-bb45-aa8f14a60193 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:15.354596 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:15.392052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53e1be-2390-45e7-87bd-f62e89fe2445 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:15.404133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10388c45-81a4-4f7d-9e64-f4c8f35679ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:15.405322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388c45-81a4-4f7d-9e64-f4c8f35679ef None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:15.405787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388c45-81a4-4f7d-9e64-f4c8f35679ef None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:15.406346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10388c45-81a4-4f7d-9e64-f4c8f35679ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:15.414505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10388c45-81a4-4f7d-9e64-f4c8f35679ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:15.416346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10388c45-81a4-4f7d-9e64-f4c8f35679ef None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:15.431187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22260ce3-175f-4692-b7fe-17676a78536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:15.431872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22260ce3-175f-4692-b7fe-17676a78536a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:15.432157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22260ce3-175f-4692-b7fe-17676a78536a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:15.432433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22260ce3-175f-4692-b7fe-17676a78536a None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:15.433176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22260ce3-175f-4692-b7fe-17676a78536a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:15.433481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22260ce3-175f-4692-b7fe-17676a78536a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-10388c45-81a4-4f7d-9e64-f4c8f35679ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:15.433913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:15.434848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:15.435781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:15.435781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:15.435781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:15.435781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:15.435781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:15.435781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:15.435781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:15.435781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:15.435781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:15.435781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:15.436305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22260ce3-175f-4692-b7fe-17676a78536a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:15.443703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 355/693] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 11 14:00:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:15.445807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac059-6a2c-4c1e-8cbc-aa9c39c1b66b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:15.446121 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac059-6a2c-4c1e-8cbc-aa9c39c1b66b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:15.446408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac059-6a2c-4c1e-8cbc-aa9c39c1b66b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:15.447944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 356/694] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:15.453455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 339/695] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:15.454783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d1b22-dfc3-4e85-94a6-037541262ddc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:15.454972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ac059-6a2c-4c1e-8cbc-aa9c39c1b66b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:15.455091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d1b22-dfc3-4e85-94a6-037541262ddc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:15.455347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d1b22-dfc3-4e85-94a6-037541262ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:15.472450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-887d1b22-dfc3-4e85-94a6-037541262ddc None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:15.473745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-887d1b22-dfc3-4e85-94a6-037541262ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:15.551493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 340/696] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:15.551493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d1b22-dfc3-4e85-94a6-037541262ddc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:15.576144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:15.598897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ac059-6a2c-4c1e-8cbc-aa9c39c1b66b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:15.640016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894112d-3678-4248-b18b-b41aa1419a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:15.641104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894112d-3678-4248-b18b-b41aa1419a88 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:15.641684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894112d-3678-4248-b18b-b41aa1419a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:15.642285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894112d-3678-4248-b18b-b41aa1419a88 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:15.643364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894112d-3678-4248-b18b-b41aa1419a88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:15.643939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894112d-3678-4248-b18b-b41aa1419a88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:15.646181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e894112d-3678-4248-b18b-b41aa1419a88 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:15.654818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d1b22-dfc3-4e85-94a6-037541262ddc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:15.671619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 357/697] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 11 14:00:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:15.672926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894112d-3678-4248-b18b-b41aa1419a88 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:15.695071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2900808-d6a9-4cac-b2e2-c1e75ce3e518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:15.695884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2900808-d6a9-4cac-b2e2-c1e75ce3e518 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:15.696168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2900808-d6a9-4cac-b2e2-c1e75ce3e518 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:15.696445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2900808-d6a9-4cac-b2e2-c1e75ce3e518 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:15.700991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:15.706775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2900808-d6a9-4cac-b2e2-c1e75ce3e518 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:15.708257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2900808-d6a9-4cac-b2e2-c1e75ce3e518 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e2900808-d6a9-4cac-b2e2-c1e75ce3e518 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:15.723337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:15.724296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:15.725218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:15.725218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:15.725218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:15.725218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:15.725218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:15.725218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:15.725218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:15.725218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:15.729857 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 341/698] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:15.730797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2900808-d6a9-4cac-b2e2-c1e75ce3e518 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:15.799627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894112d-3678-4248-b18b-b41aa1419a88 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:15.824396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:15.840079 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2900808-d6a9-4cac-b2e2-c1e75ce3e518 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:15.851556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a79e4-64f4-4b00-bf8f-c8ccf5bd5785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:15.852766 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a79e4-64f4-4b00-bf8f-c8ccf5bd5785 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:15.853273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a79e4-64f4-4b00-bf8f-c8ccf5bd5785 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:15.853782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a79e4-64f4-4b00-bf8f-c8ccf5bd5785 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:15.854803 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a79e4-64f4-4b00-bf8f-c8ccf5bd5785 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:15.856450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a79e4-64f4-4b00-bf8f-c8ccf5bd5785 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-258a79e4-64f4-4b00-bf8f-c8ccf5bd5785 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:15.874096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:15.875201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:00:15.876066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:15.877885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593715b-1531-4a3d-a314-b101c09b33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:15.878595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593715b-1531-4a3d-a314-b101c09b33a4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:15.878877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593715b-1531-4a3d-a314-b101c09b33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:15.879155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593715b-1531-4a3d-a314-b101c09b33a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:15.884964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 358/699] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Jul 11 14:00:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:15.886419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a79e4-64f4-4b00-bf8f-c8ccf5bd5785 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:15.952755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593715b-1531-4a3d-a314-b101c09b33a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:15.954258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593715b-1531-4a3d-a314-b101c09b33a4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:15.997739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a79e4-64f4-4b00-bf8f-c8ccf5bd5785 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:16.010529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:16.038028 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc458-5e32-44da-812e-4a4d16af3947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:16.039648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc458-5e32-44da-812e-4a4d16af3947 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:16.040149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc458-5e32-44da-812e-4a4d16af3947 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:16.040636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fc458-5e32-44da-812e-4a4d16af3947 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:16.041757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fc458-5e32-44da-812e-4a4d16af3947 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:16.042283 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:16.043192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fc458-5e32-44da-812e-4a4d16af3947 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:16.046032 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fc458-5e32-44da-812e-4a4d16af3947 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:16.063459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 342/700] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 11 14:00:16.063459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593715b-1531-4a3d-a314-b101c09b33a4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:16.065894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 359/701] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:16.067046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc458-5e32-44da-812e-4a4d16af3947 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:16.191971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593715b-1531-4a3d-a314-b101c09b33a4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:16.197054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fc458-5e32-44da-812e-4a4d16af3947 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:16.243331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c6236-abbb-4420-ba98-70b56a10916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:16.243968 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6236-abbb-4420-ba98-70b56a10916b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:16.244251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6236-abbb-4420-ba98-70b56a10916b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:16.244527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6236-abbb-4420-ba98-70b56a10916b None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:16.245247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c6236-abbb-4420-ba98-70b56a10916b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:16.245553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c6236-abbb-4420-ba98-70b56a10916b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:16.246015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec5318-3cdb-4803-8a98-cef66576f91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:16.246965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c6236-abbb-4420-ba98-70b56a10916b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:16.247304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec5318-3cdb-4803-8a98-cef66576f91f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:16.247783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec5318-3cdb-4803-8a98-cef66576f91f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:16.248562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec5318-3cdb-4803-8a98-cef66576f91f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:16.256414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 343/702] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 11 14:00:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:16.256414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c6236-abbb-4420-ba98-70b56a10916b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:16.268536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec5318-3cdb-4803-8a98-cef66576f91f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:16.271286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec5318-3cdb-4803-8a98-cef66576f91f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:16.274331 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-f4ec5318-3cdb-4803-8a98-cef66576f91f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:16.298463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:16.299472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:16.300396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:16.300396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:16.300396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:16.300396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:16.307592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 360/703] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:16.307592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec5318-3cdb-4803-8a98-cef66576f91f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:16.317479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:16.371858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c6236-abbb-4420-ba98-70b56a10916b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:16.408450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa1ffb-3ebc-4afd-a6d7-d964bce91017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:16.408880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa1ffb-3ebc-4afd-a6d7-d964bce91017 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:16.409165 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa1ffb-3ebc-4afd-a6d7-d964bce91017 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:16.409437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa1ffb-3ebc-4afd-a6d7-d964bce91017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:16.410324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa1ffb-3ebc-4afd-a6d7-d964bce91017 None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=945586c90ac148b8880b9ad6409b02f5) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:16.410640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa1ffb-3ebc-4afd-a6d7-d964bce91017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:16.412119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa1ffb-3ebc-4afd-a6d7-d964bce91017 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:16.426327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 344/704] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:16 2022] GET /identity/v3/role_assignments?user.id=945586c90ac148b8880b9ad6409b02f5&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:16.427334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa1ffb-3ebc-4afd-a6d7-d964bce91017 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:16.447555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec5318-3cdb-4803-8a98-cef66576f91f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:16.492771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de722f-794b-4b06-8839-3c195e060e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:16.494454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de722f-794b-4b06-8839-3c195e060e49 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:16.494971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de722f-794b-4b06-8839-3c195e060e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:16.495619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de722f-794b-4b06-8839-3c195e060e49 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:16.496582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de722f-794b-4b06-8839-3c195e060e49 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:16.497098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de722f-794b-4b06-8839-3c195e060e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:16.498903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de722f-794b-4b06-8839-3c195e060e49 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:16.507235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 361/705] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 11 14:00:16 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:16.636235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa1ffb-3ebc-4afd-a6d7-d964bce91017 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:16.653651 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:16.685480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f27a84-bc9c-461b-a38a-ca0675194629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:16.686183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27a84-bc9c-461b-a38a-ca0675194629 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:16.686521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27a84-bc9c-461b-a38a-ca0675194629 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:16.686801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f27a84-bc9c-461b-a38a-ca0675194629 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:16.687595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f27a84-bc9c-461b-a38a-ca0675194629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:16.687908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f27a84-bc9c-461b-a38a-ca0675194629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:16.689349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f27a84-bc9c-461b-a38a-ca0675194629 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:16.711175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 345/706] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:16.718090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de722f-794b-4b06-8839-3c195e060e49 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:16.790415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:16.795067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba68327-92d6-4d69-8be7-cb2e073a0a51 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:16.795357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba68327-92d6-4d69-8be7-cb2e073a0a51 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:16.795709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba68327-92d6-4d69-8be7-cb2e073a0a51 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:16.797316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 346/707] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:00:16.803267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c548c43-77a3-4307-a551-1eda92f70c18 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:16.803558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c548c43-77a3-4307-a551-1eda92f70c18 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:16.803881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c548c43-77a3-4307-a551-1eda92f70c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:16.839228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3c548c43-77a3-4307-a551-1eda92f70c18 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:16.840443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3c548c43-77a3-4307-a551-1eda92f70c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:16.844913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de722f-794b-4b06-8839-3c195e060e49 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:16.894342 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fc0dd-d59b-496d-8113-2c0e6ac2ea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:16.895407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fc0dd-d59b-496d-8113-2c0e6ac2ea02 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:16.895708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fc0dd-d59b-496d-8113-2c0e6ac2ea02 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:16.896034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fc0dd-d59b-496d-8113-2c0e6ac2ea02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:16.904368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fc0dd-d59b-496d-8113-2c0e6ac2ea02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:16.905839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fc0dd-d59b-496d-8113-2c0e6ac2ea02 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-0c6fc0dd-d59b-496d-8113-2c0e6ac2ea02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:16.922095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:16.923111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:16.924002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:16.924002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:16.924002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:16.924002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:16.924002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:16.924002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:16.924002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:16.924002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:16.924002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 362/708] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:16.924960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c157758-3c43-4d2f-bea4-aa8c594ea7d7 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:16.924960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c157758-3c43-4d2f-bea4-aa8c594ea7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:16.925339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c157758-3c43-4d2f-bea4-aa8c594ea7d7 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:16.927001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 363/709] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:16.933271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824bf21-f9e6-4f30-8e21-7b0ea201fd79 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:16.933567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824bf21-f9e6-4f30-8e21-7b0ea201fd79 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:16.933849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824bf21-f9e6-4f30-8e21-7b0ea201fd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:16.939718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 347/710] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 11 14:00:16.941429 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c548c43-77a3-4307-a551-1eda92f70c18 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:16.953007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-3824bf21-f9e6-4f30-8e21-7b0ea201fd79 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:16.954231 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3824bf21-f9e6-4f30-8e21-7b0ea201fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:17.054098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 364/711] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:17.055046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824bf21-f9e6-4f30-8e21-7b0ea201fd79 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:17.088853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c548c43-77a3-4307-a551-1eda92f70c18 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:17.093385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:17.137611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:17.140310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712fe87-e565-4e56-bbb8-4541bf1243be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:17.141410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712fe87-e565-4e56-bbb8-4541bf1243be None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:17.141873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712fe87-e565-4e56-bbb8-4541bf1243be None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:17.142788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712fe87-e565-4e56-bbb8-4541bf1243be None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:17.143785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712fe87-e565-4e56-bbb8-4541bf1243be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:17.144545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712fe87-e565-4e56-bbb8-4541bf1243be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:17.146954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712fe87-e565-4e56-bbb8-4541bf1243be None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:17.165288 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 348/712] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:17.166475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712fe87-e565-4e56-bbb8-4541bf1243be None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:17.209793 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824bf21-f9e6-4f30-8e21-7b0ea201fd79 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:17.252992 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1d083-47f4-4e6f-b3b9-c3fb4af4592b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:17.253714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d083-47f4-4e6f-b3b9-c3fb4af4592b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:17.254002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d083-47f4-4e6f-b3b9-c3fb4af4592b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:17.254314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1d083-47f4-4e6f-b3b9-c3fb4af4592b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:17.265912 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1d083-47f4-4e6f-b3b9-c3fb4af4592b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:17.267404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1d083-47f4-4e6f-b3b9-c3fb4af4592b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-09f1d083-47f4-4e6f-b3b9-c3fb4af4592b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:17.287113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:17.288119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:17.289204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:17.289204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:17.289204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:17.289204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:17.293221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 365/713] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:17.294209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1d083-47f4-4e6f-b3b9-c3fb4af4592b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:17.315591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712fe87-e565-4e56-bbb8-4541bf1243be None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:17.363325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8345b6c-e00c-451f-bdde-651e1ef46ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:17.364750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8345b6c-e00c-451f-bdde-651e1ef46ccd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:17.365613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8345b6c-e00c-451f-bdde-651e1ef46ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:17.366378 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8345b6c-e00c-451f-bdde-651e1ef46ccd None admin] PATH_INFO: `/v3/services/network` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:17.368401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8345b6c-e00c-451f-bdde-651e1ef46ccd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:17.370716 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8345b6c-e00c-451f-bdde-651e1ef46ccd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e8345b6c-e00c-451f-bdde-651e1ef46ccd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:17.388601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:17.389671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:00:17.390534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:17.392189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 349/714] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:17 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:17.394228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8345b6c-e00c-451f-bdde-651e1ef46ccd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:17.419957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:17.423716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1d083-47f4-4e6f-b3b9-c3fb4af4592b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:17.437782 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:17.465242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3f0cb-c081-4836-ad25-3094d752bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:17.466021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3f0cb-c081-4836-ad25-3094d752bb78 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:17.466416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3f0cb-c081-4836-ad25-3094d752bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:17.466768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3f0cb-c081-4836-ad25-3094d752bb78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:17.467699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3f0cb-c081-4836-ad25-3094d752bb78 None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=38a31386700941c9b103720a64bac405) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:17.468095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3f0cb-c081-4836-ad25-3094d752bb78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:17.469798 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3f0cb-c081-4836-ad25-3094d752bb78 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:17.477736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 366/715] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:17 2022] GET /identity/v3/role_assignments?user.id=38a31386700941c9b103720a64bac405&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=57f1335a97b5490cb0853894c2faf62c => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:17.478931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3f0cb-c081-4836-ad25-3094d752bb78 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:17.535773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8345b6c-e00c-451f-bdde-651e1ef46ccd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:17.576616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c0be4-41fb-4ce9-8739-e0ed67229be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:17.577296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c0be4-41fb-4ce9-8739-e0ed67229be1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:17.577693 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c0be4-41fb-4ce9-8739-e0ed67229be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:17.578047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c0be4-41fb-4ce9-8739-e0ed67229be1 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:17.579354 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c0be4-41fb-4ce9-8739-e0ed67229be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:17.579354 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c0be4-41fb-4ce9-8739-e0ed67229be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:17.580767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c0be4-41fb-4ce9-8739-e0ed67229be1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:17.600004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 350/716] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:17.602497 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c0be4-41fb-4ce9-8739-e0ed67229be1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:17.620405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3f0cb-c081-4836-ad25-3094d752bb78 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:17.663272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1cf6a-acf6-4cbc-9faf-b44b893710f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:17.664826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1cf6a-acf6-4cbc-9faf-b44b893710f9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:17.665578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1cf6a-acf6-4cbc-9faf-b44b893710f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:17.666018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1cf6a-acf6-4cbc-9faf-b44b893710f9 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:17.667234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1cf6a-acf6-4cbc-9faf-b44b893710f9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:17.667747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1cf6a-acf6-4cbc-9faf-b44b893710f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:17.669888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1cf6a-acf6-4cbc-9faf-b44b893710f9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:17.676134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 367/717] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:17.685263 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1cf6a-acf6-4cbc-9faf-b44b893710f9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:17.737783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:17.762434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:17.776876 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c0be4-41fb-4ce9-8739-e0ed67229be1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:17.813719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bc267-66fe-4c50-b573-a00aa4b4a683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:17.814432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bc267-66fe-4c50-b573-a00aa4b4a683 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:17.814714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bc267-66fe-4c50-b573-a00aa4b4a683 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:17.814992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bc267-66fe-4c50-b573-a00aa4b4a683 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:17.815700 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bc267-66fe-4c50-b573-a00aa4b4a683 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:17.817189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bc267-66fe-4c50-b573-a00aa4b4a683 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:17.840911 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 351/718] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 14:00:17 2022] POST /identity/v3/users => generated 254 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:00:17.859758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1cf6a-acf6-4cbc-9faf-b44b893710f9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:17.901832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3b463-e348-4f82-8f7b-7dbce976a9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:17.902595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3b463-e348-4f82-8f7b-7dbce976a9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:17.902882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3b463-e348-4f82-8f7b-7dbce976a9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:17.903159 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3b463-e348-4f82-8f7b-7dbce976a9d6 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:17.903893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3b463-e348-4f82-8f7b-7dbce976a9d6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:17.904248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3b463-e348-4f82-8f7b-7dbce976a9d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:17.905738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3b463-e348-4f82-8f7b-7dbce976a9d6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:17.911741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 368/719] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:19.013387 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69b26-3258-44bc-b7c8-92cd373a8319 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:19.013918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69b26-3258-44bc-b7c8-92cd373a8319 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:19.013918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b69b26-3258-44bc-b7c8-92cd373a8319 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:19.015587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 352/720] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:19.020834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5483f-269e-4c1f-b412-9b3a7ec3b05b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:19.021238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5483f-269e-4c1f-b412-9b3a7ec3b05b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:19.021429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5483f-269e-4c1f-b412-9b3a7ec3b05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:19.043228 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-89d5483f-269e-4c1f-b412-9b3a7ec3b05b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:19.044440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-89d5483f-269e-4c1f-b412-9b3a7ec3b05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:19.128450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 369/721] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:19.166450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b69b26-3258-44bc-b7c8-92cd373a8319 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:19.203222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecb406-9adb-46ec-b508-6788a1fc376e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:19.203840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecb406-9adb-46ec-b508-6788a1fc376e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:19.204350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecb406-9adb-46ec-b508-6788a1fc376e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:19.206198 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 370/722] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:19.217952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2f3cd-b0c1-4f29-8264-fdc384ec3c7a None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:19.218531 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2f3cd-b0c1-4f29-8264-fdc384ec3c7a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:19.219044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2f3cd-b0c1-4f29-8264-fdc384ec3c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:19.246457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-7be2f3cd-b0c1-4f29-8264-fdc384ec3c7a None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:19.247986 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7be2f3cd-b0c1-4f29-8264-fdc384ec3c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:19.290035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:19.313175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b69b26-3258-44bc-b7c8-92cd373a8319 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:19.361361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf602a1-ae14-44e4-9ec3-554ff780ab8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:19.367661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf602a1-ae14-44e4-9ec3-554ff780ab8f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:19.368025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf602a1-ae14-44e4-9ec3-554ff780ab8f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:19.368302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf602a1-ae14-44e4-9ec3-554ff780ab8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:19.372459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 371/723] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:19.389781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf602a1-ae14-44e4-9ec3-554ff780ab8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:19.398854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2f3cd-b0c1-4f29-8264-fdc384ec3c7a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1cf602a1-ae14-44e4-9ec3-554ff780ab8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:19.399849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:19.400763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:19.401600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:19.408138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 353/724] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:19.414360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf602a1-ae14-44e4-9ec3-554ff780ab8f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:19.430645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:19.552246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2f3cd-b0c1-4f29-8264-fdc384ec3c7a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:19.581875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf602a1-ae14-44e4-9ec3-554ff780ab8f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:19.626630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77187e8d-6de1-4422-acfc-98f3b5053638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:19.627692 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a3ff2-ca5c-470a-a699-7e52e6f84c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:19.628008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77187e8d-6de1-4422-acfc-98f3b5053638 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:19.628382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a3ff2-ca5c-470a-a699-7e52e6f84c31 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:19.628675 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a3ff2-ca5c-470a-a699-7e52e6f84c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:19.628940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77187e8d-6de1-4422-acfc-98f3b5053638 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:19.629058 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a3ff2-ca5c-470a-a699-7e52e6f84c31 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:19.629516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77187e8d-6de1-4422-acfc-98f3b5053638 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:19.629700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a3ff2-ca5c-470a-a699-7e52e6f84c31 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:19.630665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77187e8d-6de1-4422-acfc-98f3b5053638 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:19.631108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a3ff2-ca5c-470a-a699-7e52e6f84c31 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:19.631403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77187e8d-6de1-4422-acfc-98f3b5053638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:19.633211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77187e8d-6de1-4422-acfc-98f3b5053638 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:19.643226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 354/725] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:19.655397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77187e8d-6de1-4422-acfc-98f3b5053638 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:19.659825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 372/726] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 14:00:19 2022] POST /identity/v3/services => generated 251 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:19.757841 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:19.807734 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77187e8d-6de1-4422-acfc-98f3b5053638 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:19.854906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd583d-fd34-4f20-87ff-2ece763a2f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:19.856078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd583d-fd34-4f20-87ff-2ece763a2f46 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:19.856566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd583d-fd34-4f20-87ff-2ece763a2f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:19.857048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd583d-fd34-4f20-87ff-2ece763a2f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:19.870274 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd583d-fd34-4f20-87ff-2ece763a2f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:19.872103 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd583d-fd34-4f20-87ff-2ece763a2f46 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-84dd583d-fd34-4f20-87ff-2ece763a2f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:19.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:19.893224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:19.894115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:19.894115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:19.894115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:19.894115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:19.896890 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 355/727] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:19.902371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a3ff2-ca5c-470a-a699-7e52e6f84c31 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:19.929668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:20.023192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a3ff2-ca5c-470a-a699-7e52e6f84c31 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:20.060943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a9a5a-76e3-4894-81e1-ba4563116b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:20.061551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a9a5a-76e3-4894-81e1-ba4563116b8d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.061842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a9a5a-76e3-4894-81e1-ba4563116b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.062122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a9a5a-76e3-4894-81e1-ba4563116b8d None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:20.062885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a9a5a-76e3-4894-81e1-ba4563116b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:20.063198 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a9a5a-76e3-4894-81e1-ba4563116b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:20.064569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a9a5a-76e3-4894-81e1-ba4563116b8d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:20.077350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 373/728] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:20.083427 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd583d-fd34-4f20-87ff-2ece763a2f46 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:20.104162 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66880ee-d9a2-44bb-9349-e44e12575d81 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.104470 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66880ee-d9a2-44bb-9349-e44e12575d81 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.104734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66880ee-d9a2-44bb-9349-e44e12575d81 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:20.106410 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 374/729] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:00:20.115147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501a97c-9ffb-4a86-a78a-045579ae967e None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.115447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501a97c-9ffb-4a86-a78a-045579ae967e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.115730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501a97c-9ffb-4a86-a78a-045579ae967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:20.134261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-3501a97c-9ffb-4a86-a78a-045579ae967e None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:20.135486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3501a97c-9ffb-4a86-a78a-045579ae967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:20.205540 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd583d-fd34-4f20-87ff-2ece763a2f46 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:20.228076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 375/730] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:20.234735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:20.260826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcf21c-a7d3-4aa2-8a1f-f48c458ff4cd None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.261163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcf21c-a7d3-4aa2-8a1f-f48c458ff4cd None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.261392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcf21c-a7d3-4aa2-8a1f-f48c458ff4cd None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:20.263360 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 376/731] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:20.264079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcf21c-a7d3-4aa2-8a1f-f48c458ff4cd None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:20.269412 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e7c18-13ca-44a6-b8e4-16da99fea578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:20.270503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7c18-13ca-44a6-b8e4-16da99fea578 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.270795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7c18-13ca-44a6-b8e4-16da99fea578 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.271069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7c18-13ca-44a6-b8e4-16da99fea578 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:20.278522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:20.279306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e7c18-13ca-44a6-b8e4-16da99fea578 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:20.280995 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e7c18-13ca-44a6-b8e4-16da99fea578 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0b4e7c18-13ca-44a6-b8e4-16da99fea578 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:20.296151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:20.297381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:20.298630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:20.298630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:20.298630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:20.298630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:20.298630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:20.298630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:20.298630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:20.298630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:20.298630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:20.298630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:20.298630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 356/732] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:20.299406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ef89-53e8-4d5d-b859-dbe0d40777a9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.299406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ef89-53e8-4d5d-b859-dbe0d40777a9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.299552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ef89-53e8-4d5d-b859-dbe0d40777a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:20.320207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-26d6ef89-53e8-4d5d-b859-dbe0d40777a9 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:20.321454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-26d6ef89-53e8-4d5d-b859-dbe0d40777a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:20.393551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 357/733] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 11 14:00:20.394449 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6ef89-53e8-4d5d-b859-dbe0d40777a9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:20.417068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcf21c-a7d3-4aa2-8a1f-f48c458ff4cd None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:20.465806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42097bea-5c41-4f22-9999-e881b070011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:20.466677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42097bea-5c41-4f22-9999-e881b070011b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.466962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42097bea-5c41-4f22-9999-e881b070011b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.467241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42097bea-5c41-4f22-9999-e881b070011b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:20.482492 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42097bea-5c41-4f22-9999-e881b070011b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-42097bea-5c41-4f22-9999-e881b070011b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:20.493669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:20.494768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 377/734] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:20.500790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42097bea-5c41-4f22-9999-e881b070011b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:20.531264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6ef89-53e8-4d5d-b859-dbe0d40777a9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:20.534600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:20.571433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:20.584984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f4645-ce39-4087-92a5-4a8f6d5b897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:20.585846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f4645-ce39-4087-92a5-4a8f6d5b897e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.586137 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f4645-ce39-4087-92a5-4a8f6d5b897e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.586440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f4645-ce39-4087-92a5-4a8f6d5b897e None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:20.587308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f4645-ce39-4087-92a5-4a8f6d5b897e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:20.587619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f4645-ce39-4087-92a5-4a8f6d5b897e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:20.589068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f4645-ce39-4087-92a5-4a8f6d5b897e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:20.613680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 358/735] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Jul 11 14:00:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:20.614768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f4645-ce39-4087-92a5-4a8f6d5b897e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:20.620860 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42097bea-5c41-4f22-9999-e881b070011b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:20.659072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb6590-c645-48fc-bf13-e8f17ec92245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:20.660184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb6590-c645-48fc-bf13-e8f17ec92245 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.660722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb6590-c645-48fc-bf13-e8f17ec92245 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.661260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb6590-c645-48fc-bf13-e8f17ec92245 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:20.662234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb6590-c645-48fc-bf13-e8f17ec92245 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:20.663891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb6590-c645-48fc-bf13-e8f17ec92245 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:20.686447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 378/736] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 14:00:20 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:20.687804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb6590-c645-48fc-bf13-e8f17ec92245 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:20.748176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f4645-ce39-4087-92a5-4a8f6d5b897e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:20.843084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcc904-401d-4d15-829c-f78d2aa0e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:20.843699 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc904-401d-4d15-829c-f78d2aa0e113 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.843982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc904-401d-4d15-829c-f78d2aa0e113 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.844256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc904-401d-4d15-829c-f78d2aa0e113 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:20.845023 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcc904-401d-4d15-829c-f78d2aa0e113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:20.845330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcc904-401d-4d15-829c-f78d2aa0e113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:20.846764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcc904-401d-4d15-829c-f78d2aa0e113 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:20.872755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 359/737] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:20.884423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6b400-8fe2-49d8-9a57-ebfa2409423a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.884731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6b400-8fe2-49d8-9a57-ebfa2409423a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.884993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6b400-8fe2-49d8-9a57-ebfa2409423a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:20.886698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 360/738] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:20.888085 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6b400-8fe2-49d8-9a57-ebfa2409423a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:20.906005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb6590-c645-48fc-bf13-e8f17ec92245 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:20.916014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:20.930821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:20.951926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fca81-2e35-4f6c-9434-07e5d64ea90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:20.952579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fca81-2e35-4f6c-9434-07e5d64ea90b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:20.952871 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fca81-2e35-4f6c-9434-07e5d64ea90b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:20.953264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fca81-2e35-4f6c-9434-07e5d64ea90b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:21.015812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6b400-8fe2-49d8-9a57-ebfa2409423a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:21.045251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fca81-2e35-4f6c-9434-07e5d64ea90b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:21.046845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fca81-2e35-4f6c-9434-07e5d64ea90b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:21.066433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1c014-845d-47bf-960a-a7e58c59740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:21.067771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1c014-845d-47bf-960a-a7e58c59740f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:21.068212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1c014-845d-47bf-960a-a7e58c59740f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:21.068954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1c014-845d-47bf-960a-a7e58c59740f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:21.086269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1c014-845d-47bf-960a-a7e58c59740f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:21.089291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1c014-845d-47bf-960a-a7e58c59740f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-80a1c014-845d-47bf-960a-a7e58c59740f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:21.114327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:21.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:21.117248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:21.117248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:21.117248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:21.117248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:21.120186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 361/739] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:21.121748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e801bb9-4ca2-46ad-a738-bdfb7ee5a661 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:21.122228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e801bb9-4ca2-46ad-a738-bdfb7ee5a661 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:21.122653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e801bb9-4ca2-46ad-a738-bdfb7ee5a661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:21.145714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3e801bb9-4ca2-46ad-a738-bdfb7ee5a661 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:21.147586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3e801bb9-4ca2-46ad-a738-bdfb7ee5a661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:21.175751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 379/740] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:00:21.176908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fca81-2e35-4f6c-9434-07e5d64ea90b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:21.214525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:21.250448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 362/741] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:21.251779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e801bb9-4ca2-46ad-a738-bdfb7ee5a661 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:21.254689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:21.311528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fca81-2e35-4f6c-9434-07e5d64ea90b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:21.361056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468b23a-be5d-4447-a11f-d418968e35ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:21.362023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468b23a-be5d-4447-a11f-d418968e35ad None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:21.362479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468b23a-be5d-4447-a11f-d418968e35ad None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:21.362911 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468b23a-be5d-4447-a11f-d418968e35ad None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:21.364399 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468b23a-be5d-4447-a11f-d418968e35ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:21.364884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468b23a-be5d-4447-a11f-d418968e35ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:21.367636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468b23a-be5d-4447-a11f-d418968e35ad None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:21.381159 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e801bb9-4ca2-46ad-a738-bdfb7ee5a661 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:21.387628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 380/742] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:21.388628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468b23a-be5d-4447-a11f-d418968e35ad None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:21.428033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a0a9-9b50-4252-80ec-2df4e6f8c601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:21.429615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a0a9-9b50-4252-80ec-2df4e6f8c601 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:21.430227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a0a9-9b50-4252-80ec-2df4e6f8c601 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:21.430657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a0a9-9b50-4252-80ec-2df4e6f8c601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:21.445652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2a0a9-9b50-4252-80ec-2df4e6f8c601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:21.447899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2a0a9-9b50-4252-80ec-2df4e6f8c601 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-84a2a0a9-9b50-4252-80ec-2df4e6f8c601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:21.472245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:21.473214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:21.474108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:21.474108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:21.474108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:21.474108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:21.475614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 363/743] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:21.477125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a0a9-9b50-4252-80ec-2df4e6f8c601 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:21.486378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:21.515741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468b23a-be5d-4447-a11f-d418968e35ad None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:21.540685 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:21.567879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369bd8f-26f2-4699-bf7e-6aac6b731000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:21.569813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bd8f-26f2-4699-bf7e-6aac6b731000 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:21.570715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bd8f-26f2-4699-bf7e-6aac6b731000 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:21.571296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bd8f-26f2-4699-bf7e-6aac6b731000 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:21.586564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369bd8f-26f2-4699-bf7e-6aac6b731000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-3369bd8f-26f2-4699-bf7e-6aac6b731000 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:21.594483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:21.595409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:21.596276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:21.598299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a0a9-9b50-4252-80ec-2df4e6f8c601 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:21.601556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 381/744] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:21.603018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369bd8f-26f2-4699-bf7e-6aac6b731000 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:21.647393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7f9c-e2ae-43b8-8663-54537ca796f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:21.649306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7f9c-e2ae-43b8-8663-54537ca796f0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:21.650196 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7f9c-e2ae-43b8-8663-54537ca796f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:21.650986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7f9c-e2ae-43b8-8663-54537ca796f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:21.661184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7f9c-e2ae-43b8-8663-54537ca796f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:21.664816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7f9c-e2ae-43b8-8663-54537ca796f0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-dc1d7f9c-e2ae-43b8-8663-54537ca796f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:21.682062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:21.683066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:21.684005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:21.684005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:21.684005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:21.684005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:21.684005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:21.684005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:21.684005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:21.684005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:21.684005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:21.684005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:21.688120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 364/745] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 11 14:00:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:21.688825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7f9c-e2ae-43b8-8663-54537ca796f0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:21.724220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369bd8f-26f2-4699-bf7e-6aac6b731000 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:21.762339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0746df-3b4e-4768-98da-fa69c7281c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:21.763198 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0746df-3b4e-4768-98da-fa69c7281c7e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:21.763488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0746df-3b4e-4768-98da-fa69c7281c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:21.763775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0746df-3b4e-4768-98da-fa69c7281c7e None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:21.764507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0746df-3b4e-4768-98da-fa69c7281c7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:21.764819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0746df-3b4e-4768-98da-fa69c7281c7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:21.766809 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0746df-3b4e-4768-98da-fa69c7281c7e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:21.784913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 382/746] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:21.785838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0746df-3b4e-4768-98da-fa69c7281c7e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:21.791348 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:21.821900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7f9c-e2ae-43b8-8663-54537ca796f0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:21.837523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:21.861084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14e294-0c96-4b15-8902-2c37e7a808e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:21.861764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14e294-0c96-4b15-8902-2c37e7a808e6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:21.862048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14e294-0c96-4b15-8902-2c37e7a808e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:21.862355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14e294-0c96-4b15-8902-2c37e7a808e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:21.863111 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14e294-0c96-4b15-8902-2c37e7a808e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:21.863419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14e294-0c96-4b15-8902-2c37e7a808e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:21.864796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14e294-0c96-4b15-8902-2c37e7a808e6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:21.878599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 365/747] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:21.879539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14e294-0c96-4b15-8902-2c37e7a808e6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:21.925310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0746df-3b4e-4768-98da-fa69c7281c7e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:21.976731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74600457-7266-4e42-890b-b91e2c7e6139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:21.977807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74600457-7266-4e42-890b-b91e2c7e6139 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:21.978323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74600457-7266-4e42-890b-b91e2c7e6139 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:21.979294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74600457-7266-4e42-890b-b91e2c7e6139 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:21.980740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74600457-7266-4e42-890b-b91e2c7e6139 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:21.981507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74600457-7266-4e42-890b-b91e2c7e6139 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:21.983501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74600457-7266-4e42-890b-b91e2c7e6139 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:21.994329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14e294-0c96-4b15-8902-2c37e7a808e6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:22.009383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 383/748] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 11 14:00:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:22.010343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74600457-7266-4e42-890b-b91e2c7e6139 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:22.041615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db215450-2c99-447d-9113-165945b604e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:22.043422 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215450-2c99-447d-9113-165945b604e7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.044170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215450-2c99-447d-9113-165945b604e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.044647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db215450-2c99-447d-9113-165945b604e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.054410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db215450-2c99-447d-9113-165945b604e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:22.057573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db215450-2c99-447d-9113-165945b604e7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:22.074297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-db215450-2c99-447d-9113-165945b604e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:22.078148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:22.079057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:22.079961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:22.079961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:22.079961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:22.079961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:22.079961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:22.079961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:22.079961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:22.079961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:22.084260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 366/749] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:22.085207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db215450-2c99-447d-9113-165945b604e7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:22.125410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:22.138267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74600457-7266-4e42-890b-b91e2c7e6139 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:22.176531 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d3b64-dbcb-4c58-9e16-966defb2e43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:22.177259 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d3b64-dbcb-4c58-9e16-966defb2e43e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.177551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d3b64-dbcb-4c58-9e16-966defb2e43e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.177830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d3b64-dbcb-4c58-9e16-966defb2e43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.189017 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d3b64-dbcb-4c58-9e16-966defb2e43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:22.190509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d3b64-dbcb-4c58-9e16-966defb2e43e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:22.204976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db215450-2c99-447d-9113-165945b604e7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-a85d3b64-dbcb-4c58-9e16-966defb2e43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:22.209660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:22.210863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:22.212500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:22.212500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:22.212500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:22.212500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:22.212500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 384/750] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:22.212500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d3b64-dbcb-4c58-9e16-966defb2e43e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:22.252488 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af72b2-fba0-4d4f-988a-fa6f246143ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:22.253717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af72b2-fba0-4d4f-988a-fa6f246143ee None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.254000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af72b2-fba0-4d4f-988a-fa6f246143ee None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.254317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af72b2-fba0-4d4f-988a-fa6f246143ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.266952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af72b2-fba0-4d4f-988a-fa6f246143ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:22.268439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af72b2-fba0-4d4f-988a-fa6f246143ee None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-57af72b2-fba0-4d4f-988a-fa6f246143ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:22.290176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:22.291176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:22.292150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:22.292150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:22.292150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:22.292150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:22.292150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 367/751] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:22.293112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006eabe-5bb3-447e-933b-125a407f2597 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.293408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006eabe-5bb3-447e-933b-125a407f2597 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.293691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006eabe-5bb3-447e-933b-125a407f2597 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.298277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 368/752] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:22.298277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006eabe-5bb3-447e-933b-125a407f2597 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:22.328538 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d3b64-dbcb-4c58-9e16-966defb2e43e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:22.344894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:22.369459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70161-b656-4df8-be29-1adc48573f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:22.370340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70161-b656-4df8-be29-1adc48573f1b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.370630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70161-b656-4df8-be29-1adc48573f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.370905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70161-b656-4df8-be29-1adc48573f1b None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.371712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f70161-b656-4df8-be29-1adc48573f1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:22.372024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f70161-b656-4df8-be29-1adc48573f1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:22.373472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f70161-b656-4df8-be29-1adc48573f1b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:22.390645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 385/753] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:22.390645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70161-b656-4df8-be29-1adc48573f1b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:22.400434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:22.415407 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006eabe-5bb3-447e-933b-125a407f2597 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:22.454067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79134baf-019c-45de-b83f-be9c7c3cdb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:22.454673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79134baf-019c-45de-b83f-be9c7c3cdb02 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.454954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79134baf-019c-45de-b83f-be9c7c3cdb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.455233 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79134baf-019c-45de-b83f-be9c7c3cdb02 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.455974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79134baf-019c-45de-b83f-be9c7c3cdb02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:22.456283 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79134baf-019c-45de-b83f-be9c7c3cdb02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:22.457634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79134baf-019c-45de-b83f-be9c7c3cdb02 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:22.469561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 369/754] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:22.470861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00696eb1-ee04-4e84-bd7d-af3cc6f1d1b5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.471148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00696eb1-ee04-4e84-bd7d-af3cc6f1d1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.471424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00696eb1-ee04-4e84-bd7d-af3cc6f1d1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.489379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-00696eb1-ee04-4e84-bd7d-af3cc6f1d1b5 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:22.490607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-00696eb1-ee04-4e84-bd7d-af3cc6f1d1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:22.511408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70161-b656-4df8-be29-1adc48573f1b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:22.548434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f193a-4a3e-4c43-8a75-f9003d14c237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:22.549238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f193a-4a3e-4c43-8a75-f9003d14c237 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.549595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f193a-4a3e-4c43-8a75-f9003d14c237 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.549883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f193a-4a3e-4c43-8a75-f9003d14c237 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.550667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f193a-4a3e-4c43-8a75-f9003d14c237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:22.550982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f193a-4a3e-4c43-8a75-f9003d14c237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:22.552360 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f193a-4a3e-4c43-8a75-f9003d14c237 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:22.578180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 370/756] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:22.578375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 386/756] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:22.578468 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00696eb1-ee04-4e84-bd7d-af3cc6f1d1b5 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:22.578552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f193a-4a3e-4c43-8a75-f9003d14c237 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:22.611753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:22.665077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:22.689307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f193a-4a3e-4c43-8a75-f9003d14c237 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:22.689502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00696eb1-ee04-4e84-bd7d-af3cc6f1d1b5 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:22.727398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4e481-6169-40b1-bcdc-3afdd538541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:22.727730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1737-0806-4370-9cf2-20f9b5c3324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:22.727988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4e481-6169-40b1-bcdc-3afdd538541a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.728268 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4e481-6169-40b1-bcdc-3afdd538541a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.728510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1737-0806-4370-9cf2-20f9b5c3324e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.728609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4e481-6169-40b1-bcdc-3afdd538541a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.728802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1737-0806-4370-9cf2-20f9b5c3324e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.729083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c1737-0806-4370-9cf2-20f9b5c3324e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.729368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4e481-6169-40b1-bcdc-3afdd538541a None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=945586c90ac148b8880b9ad6409b02f5) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:22.729680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4e481-6169-40b1-bcdc-3afdd538541a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:22.731149 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4e481-6169-40b1-bcdc-3afdd538541a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:22.746557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c1737-0806-4370-9cf2-20f9b5c3324e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:22.746785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 371/757] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:22 2022] GET /identity/v3/role_assignments?user.id=945586c90ac148b8880b9ad6409b02f5&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=57f1335a97b5490cb0853894c2faf62c => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:22.746785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4e481-6169-40b1-bcdc-3afdd538541a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:22.746935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c1737-0806-4370-9cf2-20f9b5c3324e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-425c1737-0806-4370-9cf2-20f9b5c3324e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:22.764296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:22.765372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 387/758] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 11 14:00:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:22.766433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1737-0806-4370-9cf2-20f9b5c3324e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:22.877424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4e481-6169-40b1-bcdc-3afdd538541a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:22.898610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:22.909207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c1737-0806-4370-9cf2-20f9b5c3324e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:22.922411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa2999-d649-4f6f-afc9-0d382446bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:22.923219 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa2999-d649-4f6f-afc9-0d382446bac1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.923507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa2999-d649-4f6f-afc9-0d382446bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.923783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa2999-d649-4f6f-afc9-0d382446bac1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.931778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa2999-d649-4f6f-afc9-0d382446bac1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:22.933255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa2999-d649-4f6f-afc9-0d382446bac1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:22.950303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2ac1e-671f-4aee-afd0-9895c14d9ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:22.951129 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2ac1e-671f-4aee-afd0-9895c14d9ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.951421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2ac1e-671f-4aee-afd0-9895c14d9ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.951703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2ac1e-671f-4aee-afd0-9895c14d9ed4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.952402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2ac1e-671f-4aee-afd0-9895c14d9ed4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-51fa2999-d649-4f6f-afc9-0d382446bac1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:22.952504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:22.953351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:22.954280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:22.954280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:22.954280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:22.954280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:22.954280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:22.954280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:22.954280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:22.954280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:22.954945 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2ac1e-671f-4aee-afd0-9895c14d9ed4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:22.958489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 372/759] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:22.959387 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa2999-d649-4f6f-afc9-0d382446bac1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:22.962357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-36f2ac1e-671f-4aee-afd0-9895c14d9ed4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:22.968431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:22.969379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:22.970268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 388/760] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Jul 11 14:00:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:22.971921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ebfd5-e228-451c-aa62-19fd1f98998a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:22.971921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ebfd5-e228-451c-aa62-19fd1f98998a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:22.971921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ebfd5-e228-451c-aa62-19fd1f98998a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:22.978395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 389/761] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:22.978395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ebfd5-e228-451c-aa62-19fd1f98998a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:23.082011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa2999-d649-4f6f-afc9-0d382446bac1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:23.092841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ebfd5-e228-451c-aa62-19fd1f98998a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:23.133546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f12877-5611-4203-aef2-1d040a33ae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:23.134272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f12877-5611-4203-aef2-1d040a33ae42 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:23.134566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f12877-5611-4203-aef2-1d040a33ae42 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:23.134849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f12877-5611-4203-aef2-1d040a33ae42 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:23.135674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f12877-5611-4203-aef2-1d040a33ae42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:23.135994 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f12877-5611-4203-aef2-1d040a33ae42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:23.137525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f12877-5611-4203-aef2-1d040a33ae42 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:23.158191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 390/762] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:23.158191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f12877-5611-4203-aef2-1d040a33ae42 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:23.180756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:23.243183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8d3de-5d22-449b-9c85-f7dd39fdc857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:23.243844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8d3de-5d22-449b-9c85-f7dd39fdc857 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:23.244067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8d3de-5d22-449b-9c85-f7dd39fdc857 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:23.244371 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8d3de-5d22-449b-9c85-f7dd39fdc857 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:23.245199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8d3de-5d22-449b-9c85-f7dd39fdc857 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:23.245511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8d3de-5d22-449b-9c85-f7dd39fdc857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:23.247018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8d3de-5d22-449b-9c85-f7dd39fdc857 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:23.265271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 373/763] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Jul 11 14:00:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:23.266607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37ef6a-376d-4a29-8a77-4488be5cb7c6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:23.266900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37ef6a-376d-4a29-8a77-4488be5cb7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:23.267174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37ef6a-376d-4a29-8a77-4488be5cb7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:23.284358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4d37ef6a-376d-4a29-8a77-4488be5cb7c6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:23.285560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4d37ef6a-376d-4a29-8a77-4488be5cb7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:23.290251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f12877-5611-4203-aef2-1d040a33ae42 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:23.329467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dc65f-7802-4920-b88b-7578af85b928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:23.330180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc65f-7802-4920-b88b-7578af85b928 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:23.330537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc65f-7802-4920-b88b-7578af85b928 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:23.331098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc65f-7802-4920-b88b-7578af85b928 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:23.331572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dc65f-7802-4920-b88b-7578af85b928 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:23.331957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dc65f-7802-4920-b88b-7578af85b928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:23.333365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1dc65f-7802-4920-b88b-7578af85b928 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:23.338842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 391/764] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 11 14:00:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:23.339653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dc65f-7802-4920-b88b-7578af85b928 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:23.352566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:23.365711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 374/765] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:23.367189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37ef6a-376d-4a29-8a77-4488be5cb7c6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:23.446829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:23.470330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dc65f-7802-4920-b88b-7578af85b928 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:23.478171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37ef6a-376d-4a29-8a77-4488be5cb7c6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:23.509747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06611e3e-35af-4652-b3e4-6dabc206ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:23.512759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06611e3e-35af-4652-b3e4-6dabc206ecb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:23.513327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06611e3e-35af-4652-b3e4-6dabc206ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:23.513461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06611e3e-35af-4652-b3e4-6dabc206ecb0 None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/38a31386700941c9b103720a64bac405/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:23.515964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06611e3e-35af-4652-b3e4-6dabc206ecb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=38a31386700941c9b103720a64bac405, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:23.517419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06611e3e-35af-4652-b3e4-6dabc206ecb0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:23.518456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01198e05-1fad-416c-af69-199f3c8ca400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:23.519217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01198e05-1fad-416c-af69-199f3c8ca400 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:23.519603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01198e05-1fad-416c-af69-199f3c8ca400 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:23.520403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01198e05-1fad-416c-af69-199f3c8ca400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:23.537567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 392/766] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:00:23 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/38a31386700941c9b103720a64bac405/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:00:23.539400 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06611e3e-35af-4652-b3e4-6dabc206ecb0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:23.601489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:23.617070 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01198e05-1fad-416c-af69-199f3c8ca400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:23.618998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01198e05-1fad-416c-af69-199f3c8ca400 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:23.693703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06611e3e-35af-4652-b3e4-6dabc206ecb0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:23.745543 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea6e3c-581f-4ae4-a595-b9336eff6cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:23.746366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea6e3c-581f-4ae4-a595-b9336eff6cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:23.746661 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea6e3c-581f-4ae4-a595-b9336eff6cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:23.746929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea6e3c-581f-4ae4-a595-b9336eff6cc5 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:23.747654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea6e3c-581f-4ae4-a595-b9336eff6cc5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:23.747961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea6e3c-581f-4ae4-a595-b9336eff6cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:23.749337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea6e3c-581f-4ae4-a595-b9336eff6cc5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:23.750291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 375/767] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:00:23.751193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01198e05-1fad-416c-af69-199f3c8ca400 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:23.755309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 393/768] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 11 14:00:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:23.759284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea6e3c-581f-4ae4-a595-b9336eff6cc5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:23.765123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:23.878336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:23.894394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea6e3c-581f-4ae4-a595-b9336eff6cc5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:23.894687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01198e05-1fad-416c-af69-199f3c8ca400 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:23.940827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247861c-8570-4041-a313-55007b1b4420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:23.941886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247861c-8570-4041-a313-55007b1b4420 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:23.942352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247861c-8570-4041-a313-55007b1b4420 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:23.942773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247861c-8570-4041-a313-55007b1b4420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:23.947225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a959-a8dd-4aaf-bb14-9534d2de8b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:23.948154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a959-a8dd-4aaf-bb14-9534d2de8b6a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:23.948530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a959-a8dd-4aaf-bb14-9534d2de8b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:23.948901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a959-a8dd-4aaf-bb14-9534d2de8b6a None admin] PATH_INFO: `/v3/services/network` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:23.949653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65a959-a8dd-4aaf-bb14-9534d2de8b6a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:23.951144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65a959-a8dd-4aaf-bb14-9534d2de8b6a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:23.956059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247861c-8570-4041-a313-55007b1b4420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:23.957699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247861c-8570-4041-a313-55007b1b4420 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-ad65a959-a8dd-4aaf-bb14-9534d2de8b6a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:23.966981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:23.968212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:00:23.969243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:23.971896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 376/769] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:23 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:23.973087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a959-a8dd-4aaf-bb14-9534d2de8b6a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-6247861c-8570-4041-a313-55007b1b4420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:23.981445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:23.982608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:23.983685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:23.983685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:23.983685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:23.983685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:23.985814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 394/770] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:23.986982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247861c-8570-4041-a313-55007b1b4420 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:24.051347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:24.101464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247861c-8570-4041-a313-55007b1b4420 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:24.107848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a959-a8dd-4aaf-bb14-9534d2de8b6a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:24.143921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9cc2c-1e2e-400a-b2ab-3ce0179d8497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:24.144989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cc2c-1e2e-400a-b2ab-3ce0179d8497 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:24.145816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cc2c-1e2e-400a-b2ab-3ce0179d8497 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:24.146421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cc2c-1e2e-400a-b2ab-3ce0179d8497 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:24.147340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9cc2c-1e2e-400a-b2ab-3ce0179d8497 None admin] RBAC: Adding query filter params (name=network) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:24.148529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9cc2c-1e2e-400a-b2ab-3ce0179d8497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:24.150119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9cc2c-1e2e-400a-b2ab-3ce0179d8497 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:24.151867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc742c-c48f-40fa-b53e-bf64961b8abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:24.152904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc742c-c48f-40fa-b53e-bf64961b8abc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:24.153186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc742c-c48f-40fa-b53e-bf64961b8abc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:24.153461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc742c-c48f-40fa-b53e-bf64961b8abc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:24.154537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc742c-c48f-40fa-b53e-bf64961b8abc None admin] RBAC: Adding query filter params (interface=public, service_id=db5dbc9d02974473a654447ff9c354dc, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:24.154870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc742c-c48f-40fa-b53e-bf64961b8abc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:24.156246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc742c-c48f-40fa-b53e-bf64961b8abc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:24.157147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 395/771] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:24.158307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9cc2c-1e2e-400a-b2ab-3ce0179d8497 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:24.166109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 377/772] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 11 14:00:23 2022] GET /identity/v3/endpoints?service_id=db5dbc9d02974473a654447ff9c354dc&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:24.166965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc742c-c48f-40fa-b53e-bf64961b8abc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:24.192491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:24.278835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9cc2c-1e2e-400a-b2ab-3ce0179d8497 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:24.305784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:24.318683 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc742c-c48f-40fa-b53e-bf64961b8abc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:24.323553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5db28-50d1-40d6-abc0-a4fe1395ccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:24.324530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5db28-50d1-40d6-abc0-a4fe1395ccd0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:24.325065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5db28-50d1-40d6-abc0-a4fe1395ccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:24.325576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5db28-50d1-40d6-abc0-a4fe1395ccd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:24.326556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5db28-50d1-40d6-abc0-a4fe1395ccd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:24.327142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5db28-50d1-40d6-abc0-a4fe1395ccd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:24.328840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5db28-50d1-40d6-abc0-a4fe1395ccd0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:24.343013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 396/773] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:24.344216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5db28-50d1-40d6-abc0-a4fe1395ccd0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:24.358385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e80932-5ee6-4974-9662-63a2e99eb975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:24.359489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80932-5ee6-4974-9662-63a2e99eb975 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:24.359766 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80932-5ee6-4974-9662-63a2e99eb975 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:24.360044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80932-5ee6-4974-9662-63a2e99eb975 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:24.361035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e80932-5ee6-4974-9662-63a2e99eb975 None admin] RBAC: Adding query filter params (type=network) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:24.361344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e80932-5ee6-4974-9662-63a2e99eb975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:24.362994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e80932-5ee6-4974-9662-63a2e99eb975 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:24.372134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 378/774] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:24.373242 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e80932-5ee6-4974-9662-63a2e99eb975 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:24.461034 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:24.472431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5db28-50d1-40d6-abc0-a4fe1395ccd0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:24.482507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e80932-5ee6-4974-9662-63a2e99eb975 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:24.516441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ea6a2-b46b-46d6-b554-75a06a1f6647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:24.517122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ea6a2-b46b-46d6-b554-75a06a1f6647 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:24.517409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ea6a2-b46b-46d6-b554-75a06a1f6647 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:24.517684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ea6a2-b46b-46d6-b554-75a06a1f6647 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:24.518499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ea6a2-b46b-46d6-b554-75a06a1f6647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:24.520707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ea6a2-b46b-46d6-b554-75a06a1f6647 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:24.521635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694494e3-42ba-4858-9f26-1e8ec6d5d413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:24.523345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694494e3-42ba-4858-9f26-1e8ec6d5d413 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:24.523622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694494e3-42ba-4858-9f26-1e8ec6d5d413 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:24.524068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694494e3-42ba-4858-9f26-1e8ec6d5d413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:24.528819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 397/775] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 11 14:00:24 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:24.530262 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ea6a2-b46b-46d6-b554-75a06a1f6647 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:24.532080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694494e3-42ba-4858-9f26-1e8ec6d5d413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:24.533575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694494e3-42ba-4858-9f26-1e8ec6d5d413 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-694494e3-42ba-4858-9f26-1e8ec6d5d413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:24.559177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:24.560125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:24.561049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:24.561049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:24.561049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:24.561049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:24.561049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:24.561049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:24.561049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:24.561049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:24.561049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 379/776] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:24.572309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694494e3-42ba-4858-9f26-1e8ec6d5d413 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:24.623516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:24.721792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ea6a2-b46b-46d6-b554-75a06a1f6647 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:24.756485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694494e3-42ba-4858-9f26-1e8ec6d5d413 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:24.779152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2bb0a-3430-4f90-a542-455376b33268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:24.779837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2bb0a-3430-4f90-a542-455376b33268 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:24.780123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2bb0a-3430-4f90-a542-455376b33268 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:24.780400 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2bb0a-3430-4f90-a542-455376b33268 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:24.781204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2bb0a-3430-4f90-a542-455376b33268 None admin] RBAC: Adding query filter params (interface=public, service_id=c519ac68639e4102b5b26ec1718dec90, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:24.781516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2bb0a-3430-4f90-a542-455376b33268 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:24.782929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2bb0a-3430-4f90-a542-455376b33268 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:24.793067 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 398/777] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 11 14:00:24 2022] GET /identity/v3/endpoints?service_id=c519ac68639e4102b5b26ec1718dec90&interface=public®ion_id=RegionOne => generated 194 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:24.799143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2bb0a-3430-4f90-a542-455376b33268 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:24.814072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55519156-856f-41fb-a87a-dfe701545a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:24.815276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55519156-856f-41fb-a87a-dfe701545a35 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:24.815769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55519156-856f-41fb-a87a-dfe701545a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:24.816250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55519156-856f-41fb-a87a-dfe701545a35 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:24.817280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55519156-856f-41fb-a87a-dfe701545a35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:24.817903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55519156-856f-41fb-a87a-dfe701545a35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:24.820304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55519156-856f-41fb-a87a-dfe701545a35 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:24.838835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 380/778] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:24.847285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55519156-856f-41fb-a87a-dfe701545a35 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:24.850369 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:24.944192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2bb0a-3430-4f90-a542-455376b33268 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:24.954975 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:24.982024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64f18f-3737-41cc-823c-4c8668ee9792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:24.982735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64f18f-3737-41cc-823c-4c8668ee9792 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:24.983021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64f18f-3737-41cc-823c-4c8668ee9792 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:24.983299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64f18f-3737-41cc-823c-4c8668ee9792 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:24.983996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64f18f-3737-41cc-823c-4c8668ee9792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:24.985645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64f18f-3737-41cc-823c-4c8668ee9792 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:24.996429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 399/779] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 11 14:00:24 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:24.996429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb18a7-5a9c-4d16-921b-1a6d4d5bdc37 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:24.996429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb18a7-5a9c-4d16-921b-1a6d4d5bdc37 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:24.996429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb18a7-5a9c-4d16-921b-1a6d4d5bdc37 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:24.996429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 400/780] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:25.002038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3625e2a-3dfa-4875-a6fc-eb9ae7147c51 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:25.002367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3625e2a-3dfa-4875-a6fc-eb9ae7147c51 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:25.002687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3625e2a-3dfa-4875-a6fc-eb9ae7147c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:25.021376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55519156-856f-41fb-a87a-dfe701545a35 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:25.038002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c3625e2a-3dfa-4875-a6fc-eb9ae7147c51 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:25.039757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c3625e2a-3dfa-4875-a6fc-eb9ae7147c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:25.122319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 401/781] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:25.133110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa316578-6f82-4328-89e8-9b1cf7e94d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:25.134034 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa316578-6f82-4328-89e8-9b1cf7e94d2f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:25.134515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa316578-6f82-4328-89e8-9b1cf7e94d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:25.135029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa316578-6f82-4328-89e8-9b1cf7e94d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:25.136073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa316578-6f82-4328-89e8-9b1cf7e94d2f None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=d1dd32e8fdec4ea989cc2e83f18944f4) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:25.136591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa316578-6f82-4328-89e8-9b1cf7e94d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:25.138249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa316578-6f82-4328-89e8-9b1cf7e94d2f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:25.149737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 381/782] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:24 2022] GET /identity/v3/role_assignments?user.id=d1dd32e8fdec4ea989cc2e83f18944f4&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:25.173269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3625e2a-3dfa-4875-a6fc-eb9ae7147c51 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:25.301311 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3625e2a-3dfa-4875-a6fc-eb9ae7147c51 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:25.311518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:25.347357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685b513-65a8-40a1-b634-54d09048680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:25.348175 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b513-65a8-40a1-b634-54d09048680e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:25.348464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b513-65a8-40a1-b634-54d09048680e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:25.348745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b513-65a8-40a1-b634-54d09048680e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:25.360421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685b513-65a8-40a1-b634-54d09048680e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8685b513-65a8-40a1-b634-54d09048680e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:25.368314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:25.369295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:25.370193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 402/783] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:25.375964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa316578-6f82-4328-89e8-9b1cf7e94d2f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:25.444870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:25.481552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa316578-6f82-4328-89e8-9b1cf7e94d2f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:25.522072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c3650-8e00-4180-9e8e-2cb960bbd139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:25.522927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c3650-8e00-4180-9e8e-2cb960bbd139 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:25.523216 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c3650-8e00-4180-9e8e-2cb960bbd139 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:25.523496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c3650-8e00-4180-9e8e-2cb960bbd139 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:25.524262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c3650-8e00-4180-9e8e-2cb960bbd139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:25.524568 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c3650-8e00-4180-9e8e-2cb960bbd139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:25.525955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c3650-8e00-4180-9e8e-2cb960bbd139 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:25.537675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 382/784] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:25.544160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685b513-65a8-40a1-b634-54d09048680e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:25.677906 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685b513-65a8-40a1-b634-54d09048680e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:25.722998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5296438-4822-47b4-8aa3-d1b6fcbad3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:25.723810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5296438-4822-47b4-8aa3-d1b6fcbad3ea None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:25.724097 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5296438-4822-47b4-8aa3-d1b6fcbad3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:25.724374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5296438-4822-47b4-8aa3-d1b6fcbad3ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:25.739825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5296438-4822-47b4-8aa3-d1b6fcbad3ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:25.741378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5296438-4822-47b4-8aa3-d1b6fcbad3ea None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-c5296438-4822-47b4-8aa3-d1b6fcbad3ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:25.759217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:25.760176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:25.761078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:25.761078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:25.761078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:25.761078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:25.761078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 403/785] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:25.766380 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c3650-8e00-4180-9e8e-2cb960bbd139 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:25.826957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4356ca0-899d-40ba-b744-b6bd0f662f94 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:25.827270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4356ca0-899d-40ba-b744-b6bd0f662f94 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:25.827526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4356ca0-899d-40ba-b744-b6bd0f662f94 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:25.829196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 404/786] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:25.835841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06c87e-bc22-4b8b-8e28-2e5d2d1d9a79 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:25.836127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06c87e-bc22-4b8b-8e28-2e5d2d1d9a79 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:25.836408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06c87e-bc22-4b8b-8e28-2e5d2d1d9a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:25.856218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4a06c87e-bc22-4b8b-8e28-2e5d2d1d9a79 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:25.857442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4a06c87e-bc22-4b8b-8e28-2e5d2d1d9a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:25.878194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:25.948217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c3650-8e00-4180-9e8e-2cb960bbd139 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:25.949879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 405/787] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:25.968977 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06c87e-bc22-4b8b-8e28-2e5d2d1d9a79 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:26.029068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:26.081901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06c87e-bc22-4b8b-8e28-2e5d2d1d9a79 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:26.086880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22376748-8287-4504-9029-e1b55199b682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:26.087563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22376748-8287-4504-9029-e1b55199b682 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:26.087846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22376748-8287-4504-9029-e1b55199b682 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:26.088118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22376748-8287-4504-9029-e1b55199b682 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:26.088853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22376748-8287-4504-9029-e1b55199b682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:26.089154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22376748-8287-4504-9029-e1b55199b682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:26.090602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22376748-8287-4504-9029-e1b55199b682 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:26.120128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706e14f-22e4-4e81-8147-a08bb028a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:26.120941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706e14f-22e4-4e81-8147-a08bb028a761 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:26.121229 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706e14f-22e4-4e81-8147-a08bb028a761 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:26.121515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706e14f-22e4-4e81-8147-a08bb028a761 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:26.124459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 383/788] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:26.129963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22376748-8287-4504-9029-e1b55199b682 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:26.133789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706e14f-22e4-4e81-8147-a08bb028a761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b706e14f-22e4-4e81-8147-a08bb028a761 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:26.142866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:26.143838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:26.144701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:26.149609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 406/789] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:26.151054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706e14f-22e4-4e81-8147-a08bb028a761 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:26.164692 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:26.281373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22376748-8287-4504-9029-e1b55199b682 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:26.319595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b28cc4-c4c7-4771-b525-8d983bd48a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:26.320424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b28cc4-c4c7-4771-b525-8d983bd48a4e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:26.320714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b28cc4-c4c7-4771-b525-8d983bd48a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:26.320996 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b28cc4-c4c7-4771-b525-8d983bd48a4e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:26.328961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b28cc4-c4c7-4771-b525-8d983bd48a4e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:26.330932 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b28cc4-c4c7-4771-b525-8d983bd48a4e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-74b28cc4-c4c7-4771-b525-8d983bd48a4e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:26.349667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:26.351228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:26.352267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:26.352267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:26.352267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:26.352267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:26.352267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:26.352267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:26.352267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:26.352267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:26.352267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:26.352267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:26.352267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 384/790] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:26.357314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b28cc4-c4c7-4771-b525-8d983bd48a4e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:26.446006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706e14f-22e4-4e81-8147-a08bb028a761 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:26.494643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:26.520350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b28cc4-c4c7-4771-b525-8d983bd48a4e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:26.567890 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f15d5-3058-47dc-a6fd-1b2d239a55ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:26.568583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f15d5-3058-47dc-a6fd-1b2d239a55ad None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:26.568865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f15d5-3058-47dc-a6fd-1b2d239a55ad None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:26.569138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f15d5-3058-47dc-a6fd-1b2d239a55ad None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:26.570736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f15d5-3058-47dc-a6fd-1b2d239a55ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:26.571054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f15d5-3058-47dc-a6fd-1b2d239a55ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:26.572624 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f15d5-3058-47dc-a6fd-1b2d239a55ad None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:26.591873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 385/791] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Jul 11 14:00:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:26.595475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f8c19-ff3e-4b8f-ac6a-fad0a846ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:26.596166 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f8c19-ff3e-4b8f-ac6a-fad0a846ccbf None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:26.596450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f8c19-ff3e-4b8f-ac6a-fad0a846ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:26.596730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f8c19-ff3e-4b8f-ac6a-fad0a846ccbf None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:26.597413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f15d5-3058-47dc-a6fd-1b2d239a55ad None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:26.597519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f8c19-ff3e-4b8f-ac6a-fad0a846ccbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:26.597793 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f8c19-ff3e-4b8f-ac6a-fad0a846ccbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:26.599196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f8c19-ff3e-4b8f-ac6a-fad0a846ccbf None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:26.610080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 407/792] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:26.615645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f8c19-ff3e-4b8f-ac6a-fad0a846ccbf None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:26.686183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:26.725336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f8c19-ff3e-4b8f-ac6a-fad0a846ccbf None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:26.775109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170395f-22dc-4452-8126-04a5b38024ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:26.776183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170395f-22dc-4452-8126-04a5b38024ed None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:26.776620 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170395f-22dc-4452-8126-04a5b38024ed None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:26.777048 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170395f-22dc-4452-8126-04a5b38024ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:26.796940 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170395f-22dc-4452-8126-04a5b38024ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:26.798843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170395f-22dc-4452-8126-04a5b38024ed None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:26.811046 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f15d5-3058-47dc-a6fd-1b2d239a55ad None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:26.824696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d170395f-22dc-4452-8126-04a5b38024ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:26.840295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:26.841406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:26.842413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:26.842413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:26.842413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:26.842413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:26.844473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 408/793] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:26.850147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170395f-22dc-4452-8126-04a5b38024ed None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:26.855927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dbd8f-d58e-4659-87a7-f6886593c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:26.855927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dbd8f-d58e-4659-87a7-f6886593c79c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:26.855927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dbd8f-d58e-4659-87a7-f6886593c79c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:26.855927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7dbd8f-d58e-4659-87a7-f6886593c79c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:26.869327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dbd8f-d58e-4659-87a7-f6886593c79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:26.871020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7dbd8f-d58e-4659-87a7-f6886593c79c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-ed7dbd8f-d58e-4659-87a7-f6886593c79c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:26.907161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:26.908295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:26.909461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:26.909461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:26.909461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:26.909461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:26.913667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 386/794] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:26.919367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dbd8f-d58e-4659-87a7-f6886593c79c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:27.039765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170395f-22dc-4452-8126-04a5b38024ed None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:27.063477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:27.081106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7dbd8f-d58e-4659-87a7-f6886593c79c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:27.087893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03291e0-720b-4aa0-a966-16101f1f9b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:27.088877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03291e0-720b-4aa0-a966-16101f1f9b42 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.089916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03291e0-720b-4aa0-a966-16101f1f9b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.090436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03291e0-720b-4aa0-a966-16101f1f9b42 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.091849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03291e0-720b-4aa0-a966-16101f1f9b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:27.092366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03291e0-720b-4aa0-a966-16101f1f9b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:27.094689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03291e0-720b-4aa0-a966-16101f1f9b42 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:27.111391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 409/795] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:27.112988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76147396-36fb-458f-a79d-956e56b85e69 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.113532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76147396-36fb-458f-a79d-956e56b85e69 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.114016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76147396-36fb-458f-a79d-956e56b85e69 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.120432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 410/796] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:27.120432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76147396-36fb-458f-a79d-956e56b85e69 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:27.127822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52ce0c-14f4-414d-8af7-0e52b1290f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:27.128501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52ce0c-14f4-414d-8af7-0e52b1290f32 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.128824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52ce0c-14f4-414d-8af7-0e52b1290f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.129105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52ce0c-14f4-414d-8af7-0e52b1290f32 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.129836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52ce0c-14f4-414d-8af7-0e52b1290f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:27.130143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52ce0c-14f4-414d-8af7-0e52b1290f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:27.131561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52ce0c-14f4-414d-8af7-0e52b1290f32 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:27.150190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 387/797] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:27.150190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fd32b-982e-4f13-b1c6-46ed7a715d93 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.150190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fd32b-982e-4f13-b1c6-46ed7a715d93 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.150190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fd32b-982e-4f13-b1c6-46ed7a715d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.167091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e66fd32b-982e-4f13-b1c6-46ed7a715d93 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:27.168433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e66fd32b-982e-4f13-b1c6-46ed7a715d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:27.185588 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:27.249404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 388/798] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:27.250799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fd32b-982e-4f13-b1c6-46ed7a715d93 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:27.278035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76147396-36fb-458f-a79d-956e56b85e69 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:27.321426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5668ae-ac06-422c-a26f-d2cb5f10d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:27.322625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5668ae-ac06-422c-a26f-d2cb5f10d59b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.323126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5668ae-ac06-422c-a26f-d2cb5f10d59b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.323611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5668ae-ac06-422c-a26f-d2cb5f10d59b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.332095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5668ae-ac06-422c-a26f-d2cb5f10d59b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:27.333946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5668ae-ac06-422c-a26f-d2cb5f10d59b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-3e5668ae-ac06-422c-a26f-d2cb5f10d59b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:27.350447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:27.352217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:27.353170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:27.353170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:27.353170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:27.353170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:27.353170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:27.353170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:27.353170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:27.353170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:27.353170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:27.353170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:27.355607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 411/799] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 11 14:00:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:27.356723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5668ae-ac06-422c-a26f-d2cb5f10d59b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:27.396880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fd32b-982e-4f13-b1c6-46ed7a715d93 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:27.401852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:27.447487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b29279-53b7-4281-b1bd-24c69e47946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:27.448373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b29279-53b7-4281-b1bd-24c69e47946e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.448665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b29279-53b7-4281-b1bd-24c69e47946e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.448942 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b29279-53b7-4281-b1bd-24c69e47946e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.458753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b29279-53b7-4281-b1bd-24c69e47946e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:27.461123 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b29279-53b7-4281-b1bd-24c69e47946e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:27.480031 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5668ae-ac06-422c-a26f-d2cb5f10d59b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a6b29279-53b7-4281-b1bd-24c69e47946e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:27.480751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:27.481620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:27.487781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:27.487781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:27.487781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:27.487781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:27.487781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:27.487781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:27.487781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:27.487781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:27.487781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 389/800] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:27.487781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b29279-53b7-4281-b1bd-24c69e47946e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:27.500086 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:27.535810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b34391-1087-40d9-95f1-f4fd024fa9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:27.536702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b34391-1087-40d9-95f1-f4fd024fa9fa None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.537049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b34391-1087-40d9-95f1-f4fd024fa9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.537335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b34391-1087-40d9-95f1-f4fd024fa9fa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.538427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b34391-1087-40d9-95f1-f4fd024fa9fa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:27.540148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b34391-1087-40d9-95f1-f4fd024fa9fa None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-02b34391-1087-40d9-95f1-f4fd024fa9fa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:27.556398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:27.557402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 11 14:00:27.558730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:27.562234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 412/801] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Jul 11 14:00:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:27.564074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b34391-1087-40d9-95f1-f4fd024fa9fa None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:27.616650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b29279-53b7-4281-b1bd-24c69e47946e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:27.656305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3075103-f823-415d-b3a3-3554f363abd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:27.656993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3075103-f823-415d-b3a3-3554f363abd8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.657279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3075103-f823-415d-b3a3-3554f363abd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.657557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3075103-f823-415d-b3a3-3554f363abd8 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.658578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3075103-f823-415d-b3a3-3554f363abd8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:27.658889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3075103-f823-415d-b3a3-3554f363abd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:27.660335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3075103-f823-415d-b3a3-3554f363abd8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:27.684095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 390/802] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 11 14:00:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:27.684095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3075103-f823-415d-b3a3-3554f363abd8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:27.702814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b34391-1087-40d9-95f1-f4fd024fa9fa None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:27.704776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:27.744280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2228b1f-d2a6-418d-b3b2-0c31d0617e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:27.745147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228b1f-d2a6-418d-b3b2-0c31d0617e16 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.745540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228b1f-d2a6-418d-b3b2-0c31d0617e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.745920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2228b1f-d2a6-418d-b3b2-0c31d0617e16 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.746854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2228b1f-d2a6-418d-b3b2-0c31d0617e16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:27.747174 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2228b1f-d2a6-418d-b3b2-0c31d0617e16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:27.748735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2228b1f-d2a6-418d-b3b2-0c31d0617e16 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:27.761844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 413/803] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:27.762725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2228b1f-d2a6-418d-b3b2-0c31d0617e16 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:27.773238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:27.807203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3075103-f823-415d-b3a3-3554f363abd8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:27.845243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c025-2884-4ffa-8d23-fd4620c5b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:27.845908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c025-2884-4ffa-8d23-fd4620c5b8ec None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.846205 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c025-2884-4ffa-8d23-fd4620c5b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.846481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c025-2884-4ffa-8d23-fd4620c5b8ec None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.847189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c025-2884-4ffa-8d23-fd4620c5b8ec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:27.847490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c025-2884-4ffa-8d23-fd4620c5b8ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:27.848850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c025-2884-4ffa-8d23-fd4620c5b8ec None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:27.853641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 391/804] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 11 14:00:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:27.854882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d6dc-315a-41a5-bda3-aa775eda49c5 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.855163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d6dc-315a-41a5-bda3-aa775eda49c5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.855434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83d6dc-315a-41a5-bda3-aa775eda49c5 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.856649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 392/805] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:27.857697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d969-ab98-42eb-b074-466828437a5a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.858275 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d969-ab98-42eb-b074-466828437a5a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.858401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d969-ab98-42eb-b074-466828437a5a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.859541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 393/806] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:27.860212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d969-ab98-42eb-b074-466828437a5a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:27.874039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2228b1f-d2a6-418d-b3b2-0c31d0617e16 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:27.912443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6bedf-e585-4e91-af78-5e4d7e3cebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:27.913773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6bedf-e585-4e91-af78-5e4d7e3cebf8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:27.914303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6bedf-e585-4e91-af78-5e4d7e3cebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:27.914595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6bedf-e585-4e91-af78-5e4d7e3cebf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:27.945599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:27.969764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d969-ab98-42eb-b074-466828437a5a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:27.984561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6bedf-e585-4e91-af78-5e4d7e3cebf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:27.986043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6bedf-e585-4e91-af78-5e4d7e3cebf8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:27.999017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:28.005129 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31578b0a-dc11-4312-abd2-ef5448fc32e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:28.006052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31578b0a-dc11-4312-abd2-ef5448fc32e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:28.006368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31578b0a-dc11-4312-abd2-ef5448fc32e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:28.006648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31578b0a-dc11-4312-abd2-ef5448fc32e2 None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/945586c90ac148b8880b9ad6409b02f5/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:28.008898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31578b0a-dc11-4312-abd2-ef5448fc32e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=945586c90ac148b8880b9ad6409b02f5, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:28.010424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31578b0a-dc11-4312-abd2-ef5448fc32e2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:28.024923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 394/807] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:00:27 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/945586c90ac148b8880b9ad6409b02f5/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:00:28.025769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31578b0a-dc11-4312-abd2-ef5448fc32e2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:28.155965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31578b0a-dc11-4312-abd2-ef5448fc32e2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:28.196934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317682b8-36d3-4bd4-8bb9-b612ce00bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:28.198001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317682b8-36d3-4bd4-8bb9-b612ce00bd78 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:28.198525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317682b8-36d3-4bd4-8bb9-b612ce00bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:28.198803 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317682b8-36d3-4bd4-8bb9-b612ce00bd78 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:28.199521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317682b8-36d3-4bd4-8bb9-b612ce00bd78 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:28.199852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317682b8-36d3-4bd4-8bb9-b612ce00bd78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:28.201342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317682b8-36d3-4bd4-8bb9-b612ce00bd78 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:28.207047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 395/808] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Jul 11 14:00:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:28.208444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f72c8-c517-4e1a-9998-822d6f137857 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:28.208731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f72c8-c517-4e1a-9998-822d6f137857 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:28.209007 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f72c8-c517-4e1a-9998-822d6f137857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:28.227030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e41f72c8-c517-4e1a-9998-822d6f137857 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:28.228569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e41f72c8-c517-4e1a-9998-822d6f137857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:28.236485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 414/809] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:00:28.238028 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9a969-ec9f-4f80-82c9-ed4b2848b3c9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:28.238509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9a969-ec9f-4f80-82c9-ed4b2848b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:28.238936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9a969-ec9f-4f80-82c9-ed4b2848b3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:28.257299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a2c9a969-ec9f-4f80-82c9-ed4b2848b3c9 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:28.258514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a2c9a969-ec9f-4f80-82c9-ed4b2848b3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:28.285507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:28.308683 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 396/810] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:28.309844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f72c8-c517-4e1a-9998-822d6f137857 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:28.329549 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:28.343137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 415/811] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:28.344322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9a969-ec9f-4f80-82c9-ed4b2848b3c9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:28.439341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f72c8-c517-4e1a-9998-822d6f137857 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:28.472934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9a969-ec9f-4f80-82c9-ed4b2848b3c9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:28.476346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12f26a-a66b-40a6-9867-a78442d31ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:28.476955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12f26a-a66b-40a6-9867-a78442d31ac8 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:28.477240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12f26a-a66b-40a6-9867-a78442d31ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:28.477518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12f26a-a66b-40a6-9867-a78442d31ac8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:28.478296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12f26a-a66b-40a6-9867-a78442d31ac8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:28.479691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a12f26a-a66b-40a6-9867-a78442d31ac8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:28.501586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 397/812] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 11 14:00:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:28.502466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12f26a-a66b-40a6-9867-a78442d31ac8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:28.541468 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac34d59-649c-4489-981d-082f676e6a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:28.542334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac34d59-649c-4489-981d-082f676e6a1e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:28.542617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac34d59-649c-4489-981d-082f676e6a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:28.542891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac34d59-649c-4489-981d-082f676e6a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:28.555037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac34d59-649c-4489-981d-082f676e6a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:28.557149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac34d59-649c-4489-981d-082f676e6a1e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:28.563745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-1ac34d59-649c-4489-981d-082f676e6a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:28.582030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:28.583143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:28.584040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:28.584040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:28.584040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:28.584040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:28.587038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 416/813] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:28.588214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac34d59-649c-4489-981d-082f676e6a1e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:28.638586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:28.645425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12f26a-a66b-40a6-9867-a78442d31ac8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:28.691592 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff814f1-e5db-4814-971f-03f4a3a12a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:28.692714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff814f1-e5db-4814-971f-03f4a3a12a00 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:28.693070 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff814f1-e5db-4814-971f-03f4a3a12a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:28.693419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff814f1-e5db-4814-971f-03f4a3a12a00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:28.708093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac34d59-649c-4489-981d-082f676e6a1e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:28.710691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff814f1-e5db-4814-971f-03f4a3a12a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-eff814f1-e5db-4814-971f-03f4a3a12a00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:28.718607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:28.719579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:28.720870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 398/814] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:28.721565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff814f1-e5db-4814-971f-03f4a3a12a00 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:28.758796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8209f56-6c63-4bf2-ad56-c50cd1691124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:28.760673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209f56-6c63-4bf2-ad56-c50cd1691124 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:28.761446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209f56-6c63-4bf2-ad56-c50cd1691124 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:28.761936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209f56-6c63-4bf2-ad56-c50cd1691124 None admin] PATH_INFO: `/v3/services/network` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:28.762953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8209f56-6c63-4bf2-ad56-c50cd1691124 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:28.765757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8209f56-6c63-4bf2-ad56-c50cd1691124 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-e8209f56-6c63-4bf2-ad56-c50cd1691124 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:28.783193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:28.784273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 11 14:00:28.785143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:28.794364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 417/815] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:28 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:28.796212 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8209f56-6c63-4bf2-ad56-c50cd1691124 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:28.841397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:28.845647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff814f1-e5db-4814-971f-03f4a3a12a00 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:28.889253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f603bd1-155f-4bfb-b2a4-db775011b2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:28.890670 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603bd1-155f-4bfb-b2a4-db775011b2de None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:28.891748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603bd1-155f-4bfb-b2a4-db775011b2de None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:28.892240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603bd1-155f-4bfb-b2a4-db775011b2de None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:28.893465 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f603bd1-155f-4bfb-b2a4-db775011b2de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:28.893983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f603bd1-155f-4bfb-b2a4-db775011b2de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:28.895864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f603bd1-155f-4bfb-b2a4-db775011b2de None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:28.913771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 399/816] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:28.915100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f603bd1-155f-4bfb-b2a4-db775011b2de None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:28.926837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8209f56-6c63-4bf2-ad56-c50cd1691124 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:28.929879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:28.967008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc640e5-2da7-4ec4-8125-aa68829810c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:28.968048 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc640e5-2da7-4ec4-8125-aa68829810c2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:28.968511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc640e5-2da7-4ec4-8125-aa68829810c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:28.968965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc640e5-2da7-4ec4-8125-aa68829810c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:28.969995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc640e5-2da7-4ec4-8125-aa68829810c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:28.970548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc640e5-2da7-4ec4-8125-aa68829810c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:28.972129 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc640e5-2da7-4ec4-8125-aa68829810c2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:28.981372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 418/817] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:28.986998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc640e5-2da7-4ec4-8125-aa68829810c2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:29.023426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f603bd1-155f-4bfb-b2a4-db775011b2de None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:29.060735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9480066-eb45-48fa-8d32-20e95545c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:29.061578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9480066-eb45-48fa-8d32-20e95545c36d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:29.061966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9480066-eb45-48fa-8d32-20e95545c36d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:29.062382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9480066-eb45-48fa-8d32-20e95545c36d None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:29.063206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9480066-eb45-48fa-8d32-20e95545c36d None admin] RBAC: Adding query filter params (name=network) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:29.063688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9480066-eb45-48fa-8d32-20e95545c36d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:29.065320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9480066-eb45-48fa-8d32-20e95545c36d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:29.076056 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 400/818] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:29.076056 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9480066-eb45-48fa-8d32-20e95545c36d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:29.099419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:29.104484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc640e5-2da7-4ec4-8125-aa68829810c2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:29.141518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd16cb-999e-4109-b528-18c28ac52138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:29.142654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd16cb-999e-4109-b528-18c28ac52138 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:29.143118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd16cb-999e-4109-b528-18c28ac52138 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:29.143568 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd16cb-999e-4109-b528-18c28ac52138 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:29.151669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd16cb-999e-4109-b528-18c28ac52138 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:29.153371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd16cb-999e-4109-b528-18c28ac52138 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-9bfd16cb-999e-4109-b528-18c28ac52138 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:29.169208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:29.170137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:29.171182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:29.171182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:29.171182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:29.171182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:29.171182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:29.171182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:29.171182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:29.171182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:29.173282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 419/819] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:29.174298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd16cb-999e-4109-b528-18c28ac52138 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:29.189089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9480066-eb45-48fa-8d32-20e95545c36d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:29.204224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:29.228377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee21a5d-c463-4770-8ab9-3082da4770c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:29.229116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee21a5d-c463-4770-8ab9-3082da4770c0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:29.229405 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee21a5d-c463-4770-8ab9-3082da4770c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:29.229684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee21a5d-c463-4770-8ab9-3082da4770c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:29.241007 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee21a5d-c463-4770-8ab9-3082da4770c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:29.243105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee21a5d-c463-4770-8ab9-3082da4770c0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0ee21a5d-c463-4770-8ab9-3082da4770c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:29.262096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:29.263224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:29.264276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:29.264276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:29.264276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:29.264276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:29.267984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 401/820] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:29.268847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee21a5d-c463-4770-8ab9-3082da4770c0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:29.294269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd16cb-999e-4109-b528-18c28ac52138 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:29.331214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f687-21d0-4c0c-9aa2-38c873d20889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:29.332558 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f687-21d0-4c0c-9aa2-38c873d20889 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:29.333016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f687-21d0-4c0c-9aa2-38c873d20889 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:29.333436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f687-21d0-4c0c-9aa2-38c873d20889 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:29.334378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479f687-21d0-4c0c-9aa2-38c873d20889 None admin] RBAC: Adding query filter params (type=network) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:29.334876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479f687-21d0-4c0c-9aa2-38c873d20889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:29.336808 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479f687-21d0-4c0c-9aa2-38c873d20889 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:29.346757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 420/821] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:29.347879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f687-21d0-4c0c-9aa2-38c873d20889 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:29.354625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:29.379993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee21a5d-c463-4770-8ab9-3082da4770c0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:29.418731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cd991-22c5-48e0-b504-9de9ef57639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:29.419458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cd991-22c5-48e0-b504-9de9ef57639a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:29.419745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cd991-22c5-48e0-b504-9de9ef57639a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:29.420022 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cd991-22c5-48e0-b504-9de9ef57639a None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:29.420811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cd991-22c5-48e0-b504-9de9ef57639a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:29.421122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cd991-22c5-48e0-b504-9de9ef57639a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:29.422589 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cd991-22c5-48e0-b504-9de9ef57639a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:29.440584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 402/822] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:29.440991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cd991-22c5-48e0-b504-9de9ef57639a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:29.462995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:29.474724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f687-21d0-4c0c-9aa2-38c873d20889 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:29.510757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614049bc-9092-481a-b29a-55ed329debf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:29.511760 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614049bc-9092-481a-b29a-55ed329debf8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:29.512248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614049bc-9092-481a-b29a-55ed329debf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:29.512728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614049bc-9092-481a-b29a-55ed329debf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:29.513654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614049bc-9092-481a-b29a-55ed329debf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:29.514203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614049bc-9092-481a-b29a-55ed329debf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:29.515780 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614049bc-9092-481a-b29a-55ed329debf8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:29.533093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 421/823] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:29.534271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614049bc-9092-481a-b29a-55ed329debf8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:29.554672 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cd991-22c5-48e0-b504-9de9ef57639a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:29.591373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33129ea9-2ea4-4bda-b1ef-82a805901cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:29.592262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33129ea9-2ea4-4bda-b1ef-82a805901cc8 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:29.592389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33129ea9-2ea4-4bda-b1ef-82a805901cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:29.592618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33129ea9-2ea4-4bda-b1ef-82a805901cc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:29.593373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33129ea9-2ea4-4bda-b1ef-82a805901cc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:29.594787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33129ea9-2ea4-4bda-b1ef-82a805901cc8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:29.599312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:29.616952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 403/824] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 11 14:00:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:29.617869 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33129ea9-2ea4-4bda-b1ef-82a805901cc8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:29.646515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614049bc-9092-481a-b29a-55ed329debf8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:29.690807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca8419-b8ad-4085-a2c4-83a576961e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:29.691892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca8419-b8ad-4085-a2c4-83a576961e45 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:29.692401 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca8419-b8ad-4085-a2c4-83a576961e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:29.692898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca8419-b8ad-4085-a2c4-83a576961e45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:29.693968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca8419-b8ad-4085-a2c4-83a576961e45 None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=38a31386700941c9b103720a64bac405) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:29.694620 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca8419-b8ad-4085-a2c4-83a576961e45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:29.696306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca8419-b8ad-4085-a2c4-83a576961e45 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:29.703625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 422/825] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:29 2022] GET /identity/v3/role_assignments?user.id=38a31386700941c9b103720a64bac405&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=57f1335a97b5490cb0853894c2faf62c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:29.760895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33129ea9-2ea4-4bda-b1ef-82a805901cc8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:29.818421 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba6b8-d950-4f5c-bc7e-89fb87f87ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:29.819910 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba6b8-d950-4f5c-bc7e-89fb87f87ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:29.820203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba6b8-d950-4f5c-bc7e-89fb87f87ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:29.820480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eba6b8-d950-4f5c-bc7e-89fb87f87ea8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:29.829653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eba6b8-d950-4f5c-bc7e-89fb87f87ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:29.831256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eba6b8-d950-4f5c-bc7e-89fb87f87ea8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-44eba6b8-d950-4f5c-bc7e-89fb87f87ea8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:29.848466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:29.849511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:29.850577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:29.850577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:29.850577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:29.850577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:29.850577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:29.850577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:29.850577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:29.850577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:29.850577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:29.850577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:29.850577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 404/826] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 11 14:00:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:29.857566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca8419-b8ad-4085-a2c4-83a576961e45 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:29.874050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:29.989422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca8419-b8ad-4085-a2c4-83a576961e45 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:30.025525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45fa53-e356-4489-bf79-ab8c2d4fbeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:30.026138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fa53-e356-4489-bf79-ab8c2d4fbeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.026448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fa53-e356-4489-bf79-ab8c2d4fbeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.026720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45fa53-e356-4489-bf79-ab8c2d4fbeb7 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.027572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45fa53-e356-4489-bf79-ab8c2d4fbeb7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:30.027881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45fa53-e356-4489-bf79-ab8c2d4fbeb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:30.029315 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45fa53-e356-4489-bf79-ab8c2d4fbeb7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:30.048186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 423/827] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Jul 11 14:00:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:30.053605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba6b8-d950-4f5c-bc7e-89fb87f87ea8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:30.114056 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:30.168043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eba6b8-d950-4f5c-bc7e-89fb87f87ea8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:30.209340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9df80-9d04-447a-912d-209b9e24ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:30.210649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9df80-9d04-447a-912d-209b9e24ef7b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.211143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9df80-9d04-447a-912d-209b9e24ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.211640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9df80-9d04-447a-912d-209b9e24ef7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.227312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9df80-9d04-447a-912d-209b9e24ef7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:30.228913 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9df80-9d04-447a-912d-209b9e24ef7b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:30.230274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba2aa-6b14-418b-8d25-eeebec3bc1a7 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.230577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba2aa-6b14-418b-8d25-eeebec3bc1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.230861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ba2aa-6b14-418b-8d25-eeebec3bc1a7 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.232492 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 424/828] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:30.237544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdcdc5-8360-4ff5-903f-9a28af3e6900 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.237839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdcdc5-8360-4ff5-903f-9a28af3e6900 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.238128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdcdc5-8360-4ff5-903f-9a28af3e6900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-bab9df80-9d04-447a-912d-209b9e24ef7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:30.249463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:30.250456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:30.251336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:30.251336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:30.251336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:30.251336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:30.251973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 405/829] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:30.255957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-33cdcdc5-8360-4ff5-903f-9a28af3e6900 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:30.257863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-33cdcdc5-8360-4ff5-903f-9a28af3e6900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:30.259110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9df80-9d04-447a-912d-209b9e24ef7b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:30.351438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:30.360407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 425/830] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:30.372573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9df80-9d04-447a-912d-209b9e24ef7b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:30.378937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:30.390073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdcdc5-8360-4ff5-903f-9a28af3e6900 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:30.416202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23150171-e78f-48ea-8438-17a0af43e489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:30.417260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23150171-e78f-48ea-8438-17a0af43e489 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.417742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23150171-e78f-48ea-8438-17a0af43e489 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.418246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23150171-e78f-48ea-8438-17a0af43e489 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.419165 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23150171-e78f-48ea-8438-17a0af43e489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:30.419667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23150171-e78f-48ea-8438-17a0af43e489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:30.421351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23150171-e78f-48ea-8438-17a0af43e489 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:30.435911 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 406/831] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:30.441936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23150171-e78f-48ea-8438-17a0af43e489 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:30.501839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdcdc5-8360-4ff5-903f-9a28af3e6900 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:30.541038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07a182-8ffd-4206-b624-0fd0d3fd6fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:30.541850 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07a182-8ffd-4206-b624-0fd0d3fd6fee None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.542138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07a182-8ffd-4206-b624-0fd0d3fd6fee None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.542446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07a182-8ffd-4206-b624-0fd0d3fd6fee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.553939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07a182-8ffd-4206-b624-0fd0d3fd6fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:30.561297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23150171-e78f-48ea-8438-17a0af43e489 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-cb07a182-8ffd-4206-b624-0fd0d3fd6fee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:30.561962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:30.563264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:30.564239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:30.568813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 426/832] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:30.570465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07a182-8ffd-4206-b624-0fd0d3fd6fee None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:30.604598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6772cdf-1746-42e3-8fd6-32ad9ccb55e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:30.605767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6772cdf-1746-42e3-8fd6-32ad9ccb55e4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.606322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6772cdf-1746-42e3-8fd6-32ad9ccb55e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.606798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6772cdf-1746-42e3-8fd6-32ad9ccb55e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.614319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6772cdf-1746-42e3-8fd6-32ad9ccb55e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:30.616147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6772cdf-1746-42e3-8fd6-32ad9ccb55e4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e6772cdf-1746-42e3-8fd6-32ad9ccb55e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:30.631330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:30.633142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:30.634059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:30.634059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:30.634059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:30.634059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:30.634059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:30.634059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:30.634059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:30.634059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:30.634536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:30.641546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 407/833] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:30.642758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6772cdf-1746-42e3-8fd6-32ad9ccb55e4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:30.671438 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:30.682902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07a182-8ffd-4206-b624-0fd0d3fd6fee None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:30.721864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eeb93-a350-495c-b0db-59d2c4b35e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:30.722712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eeb93-a350-495c-b0db-59d2c4b35e61 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.723009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eeb93-a350-495c-b0db-59d2c4b35e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.723289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20eeb93-a350-495c-b0db-59d2c4b35e61 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.724054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eeb93-a350-495c-b0db-59d2c4b35e61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:30.724368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eeb93-a350-495c-b0db-59d2c4b35e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:30.725818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20eeb93-a350-495c-b0db-59d2c4b35e61 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:30.739989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 427/834] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:30.741644 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eeb93-a350-495c-b0db-59d2c4b35e61 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:30.753810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6772cdf-1746-42e3-8fd6-32ad9ccb55e4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:30.791271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62338df-5832-47c6-8165-f1e48e813a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:30.791963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62338df-5832-47c6-8165-f1e48e813a07 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.792246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62338df-5832-47c6-8165-f1e48e813a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.792521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62338df-5832-47c6-8165-f1e48e813a07 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.793401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62338df-5832-47c6-8165-f1e48e813a07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:30.793623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62338df-5832-47c6-8165-f1e48e813a07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:30.795100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62338df-5832-47c6-8165-f1e48e813a07 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:30.812715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 408/835] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:30.813870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d9abf-6019-4ec5-9144-95a9e7192a65 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.814172 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d9abf-6019-4ec5-9144-95a9e7192a65 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.814454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d9abf-6019-4ec5-9144-95a9e7192a65 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.815847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 409/836] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:30.816374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d9abf-6019-4ec5-9144-95a9e7192a65 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:30.858399 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20eeb93-a350-495c-b0db-59d2c4b35e61 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:30.882583 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:30.900188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b84efc-7aa9-472c-b500-565071e78034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:30.900993 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b84efc-7aa9-472c-b500-565071e78034 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.901272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b84efc-7aa9-472c-b500-565071e78034 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.901544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b84efc-7aa9-472c-b500-565071e78034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.911679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:30.912481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b84efc-7aa9-472c-b500-565071e78034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:30.914537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b84efc-7aa9-472c-b500-565071e78034 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:30.931629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d9abf-6019-4ec5-9144-95a9e7192a65 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-65b84efc-7aa9-472c-b500-565071e78034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:30.933211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:30.934073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:30.935015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:30.935015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:30.935015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:30.935015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:30.935015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 428/837] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:30.936476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f367-c137-40a6-9fff-cd45df5520b5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.936476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f367-c137-40a6-9fff-cd45df5520b5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.936476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7f367-c137-40a6-9fff-cd45df5520b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.953534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c6e7f367-c137-40a6-9fff-cd45df5520b5 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:30.954733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c6e7f367-c137-40a6-9fff-cd45df5520b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:30.974187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43f215-e531-41e8-b831-938387ab4cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:30.975437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f215-e531-41e8-b831-938387ab4cc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:30.975885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f215-e531-41e8-b831-938387ab4cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:30.976483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43f215-e531-41e8-b831-938387ab4cc3 None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/d1dd32e8fdec4ea989cc2e83f18944f4/roles/2fe302f59f134744aaac6a31934efeea` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:30.997716 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43f215-e531-41e8-b831-938387ab4cc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=d1dd32e8fdec4ea989cc2e83f18944f4, role_id=2fe302f59f134744aaac6a31934efeea)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:30.999185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc43f215-e531-41e8-b831-938387ab4cc3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:31.014136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 410/838] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:00:30 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/d1dd32e8fdec4ea989cc2e83f18944f4/roles/2fe302f59f134744aaac6a31934efeea => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:00:31.014979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43f215-e531-41e8-b831-938387ab4cc3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:31.052002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 429/839] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:31.076033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7f367-c137-40a6-9fff-cd45df5520b5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:31.158205 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc43f215-e531-41e8-b831-938387ab4cc3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:31.207453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7f367-c137-40a6-9fff-cd45df5520b5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:31.213296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:31.213545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e674ce7-d795-4e9d-bde2-76fcff2439ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:31.213545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e674ce7-d795-4e9d-bde2-76fcff2439ff None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:31.213545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e674ce7-d795-4e9d-bde2-76fcff2439ff None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:31.213545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e674ce7-d795-4e9d-bde2-76fcff2439ff None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:31.213893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e674ce7-d795-4e9d-bde2-76fcff2439ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:31.214287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e674ce7-d795-4e9d-bde2-76fcff2439ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:31.215783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e674ce7-d795-4e9d-bde2-76fcff2439ff None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:31.218545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:31.236114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 411/840] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:31.242713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e674ce7-d795-4e9d-bde2-76fcff2439ff None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:31.255954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9f58-c671-4263-8df3-c4afbf413346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:31.257566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9f58-c671-4263-8df3-c4afbf413346 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:31.257967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9f58-c671-4263-8df3-c4afbf413346 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:31.258385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9f58-c671-4263-8df3-c4afbf413346 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:31.259144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf9f58-c671-4263-8df3-c4afbf413346 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:31.260619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf9f58-c671-4263-8df3-c4afbf413346 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-caaf9f58-c671-4263-8df3-c4afbf413346 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:31.274424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:31.275703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:00:31.276745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:31.278919 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 430/841] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 14:00:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:31.286557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9f58-c671-4263-8df3-c4afbf413346 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:31.374092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e674ce7-d795-4e9d-bde2-76fcff2439ff None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:31.418010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c708f-7b25-4373-9f2d-c857104e78c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:31.418885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c708f-7b25-4373-9f2d-c857104e78c6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:31.419236 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c708f-7b25-4373-9f2d-c857104e78c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:31.419577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c708f-7b25-4373-9f2d-c857104e78c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:31.421386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9f58-c671-4263-8df3-c4afbf413346 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:31.428174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c708f-7b25-4373-9f2d-c857104e78c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:31.430665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c708f-7b25-4373-9f2d-c857104e78c6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-868c708f-7b25-4373-9f2d-c857104e78c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:31.446556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:31.447647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:31.448591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:31.448591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:31.448591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:31.448591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:31.448591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:31.448591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:31.448591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:31.448591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:31.448591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 11 14:00:31.448591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:31.452936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 412/842] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:31.453879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c708f-7b25-4373-9f2d-c857104e78c6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:31.461857 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f078f2-a181-4804-b15b-648df780bab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:31.462868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f078f2-a181-4804-b15b-648df780bab2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:31.463383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f078f2-a181-4804-b15b-648df780bab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:31.464049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f078f2-a181-4804-b15b-648df780bab2 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:31.465035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f078f2-a181-4804-b15b-648df780bab2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:31.465547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f078f2-a181-4804-b15b-648df780bab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:31.467174 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f078f2-a181-4804-b15b-648df780bab2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:31.472969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 431/843] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 14:00:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:31.480453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f078f2-a181-4804-b15b-648df780bab2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:31.515027 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:31.520869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:31.571049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c708f-7b25-4373-9f2d-c857104e78c6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:31.609761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283bb3d-1e8b-4072-a202-8a8ebf46177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:31.610755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283bb3d-1e8b-4072-a202-8a8ebf46177d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:31.611317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283bb3d-1e8b-4072-a202-8a8ebf46177d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:31.612052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283bb3d-1e8b-4072-a202-8a8ebf46177d None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:31.613341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283bb3d-1e8b-4072-a202-8a8ebf46177d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:31.613807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283bb3d-1e8b-4072-a202-8a8ebf46177d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:31.616749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283bb3d-1e8b-4072-a202-8a8ebf46177d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:31.618688 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f078f2-a181-4804-b15b-648df780bab2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:31.643960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 413/844] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Jul 11 14:00:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:31.645923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283bb3d-1e8b-4072-a202-8a8ebf46177d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:31.663879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94753a0-fab0-49de-8f2e-5ea0402d57b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:31.665207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94753a0-fab0-49de-8f2e-5ea0402d57b8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:31.665724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94753a0-fab0-49de-8f2e-5ea0402d57b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:31.666413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94753a0-fab0-49de-8f2e-5ea0402d57b8 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:31.667847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94753a0-fab0-49de-8f2e-5ea0402d57b8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:31.668420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94753a0-fab0-49de-8f2e-5ea0402d57b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:31.670565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94753a0-fab0-49de-8f2e-5ea0402d57b8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:31.677981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 432/845] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 14:00:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:31.766626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283bb3d-1e8b-4072-a202-8a8ebf46177d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:31.783569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:31.808862 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02790f82-26e9-4de6-8e4f-1935e5cb7366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:31.809550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790f82-26e9-4de6-8e4f-1935e5cb7366 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:31.809834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790f82-26e9-4de6-8e4f-1935e5cb7366 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:31.810115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02790f82-26e9-4de6-8e4f-1935e5cb7366 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:31.885903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02790f82-26e9-4de6-8e4f-1935e5cb7366 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:31.887524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02790f82-26e9-4de6-8e4f-1935e5cb7366 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:31.993165 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 414/846] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:00:31.998795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94753a0-fab0-49de-8f2e-5ea0402d57b8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:32.098599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:32.105501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94753a0-fab0-49de-8f2e-5ea0402d57b8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:32.107357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff2d6-890d-480e-a391-a049af7e2321 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:32.107657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff2d6-890d-480e-a391-a049af7e2321 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:32.107967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bff2d6-890d-480e-a391-a049af7e2321 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:32.109585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 415/847] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:32.114729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c49c2-7717-459f-9d1a-7c1b453755bb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:32.115023 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c49c2-7717-459f-9d1a-7c1b453755bb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:32.115308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c49c2-7717-459f-9d1a-7c1b453755bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:32.136337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-796c49c2-7717-459f-9d1a-7c1b453755bb None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:32.138024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-796c49c2-7717-459f-9d1a-7c1b453755bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:32.142681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb2190-4470-42cd-a90d-ec8130184cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:32.143789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2190-4470-42cd-a90d-ec8130184cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:32.144224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2190-4470-42cd-a90d-ec8130184cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:32.144664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb2190-4470-42cd-a90d-ec8130184cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:32.147323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:32.158195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb2190-4470-42cd-a90d-ec8130184cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:32.159711 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb2190-4470-42cd-a90d-ec8130184cd0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-6bcb2190-4470-42cd-a90d-ec8130184cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:32.178193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:32.179500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:32.180428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:32.180428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:32.180428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:32.180428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:32.183951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 433/848] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:32.185522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb2190-4470-42cd-a90d-ec8130184cd0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:32.233226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 416/849] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:32.256264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c49c2-7717-459f-9d1a-7c1b453755bb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:32.304277 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb2190-4470-42cd-a90d-ec8130184cd0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:32.353792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d840-47b8-441e-b84b-0d50735a324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:32.355081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d840-47b8-441e-b84b-0d50735a324a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:32.355581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d840-47b8-441e-b84b-0d50735a324a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:32.356092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d840-47b8-441e-b84b-0d50735a324a None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:32.357047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d840-47b8-441e-b84b-0d50735a324a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:32.357594 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d840-47b8-441e-b84b-0d50735a324a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:32.359498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d840-47b8-441e-b84b-0d50735a324a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:32.380144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c49c2-7717-459f-9d1a-7c1b453755bb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:32.381443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 434/850] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:32.383638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d840-47b8-441e-b84b-0d50735a324a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:32.412191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:32.417213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb8a38-1e4b-4bdf-9950-c59767d02374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:32.418355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb8a38-1e4b-4bdf-9950-c59767d02374 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:32.418628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb8a38-1e4b-4bdf-9950-c59767d02374 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:32.418907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb8a38-1e4b-4bdf-9950-c59767d02374 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:32.419575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb8a38-1e4b-4bdf-9950-c59767d02374 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:32.421668 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb8a38-1e4b-4bdf-9950-c59767d02374 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9ffb8a38-1e4b-4bdf-9950-c59767d02374 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:32.438757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:32.439770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:32.440639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 417/851] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Jul 11 14:00:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:32.448763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb8a38-1e4b-4bdf-9950-c59767d02374 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:32.459116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:32.509648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d840-47b8-441e-b84b-0d50735a324a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:32.546975 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29ff94-c648-494f-9fe8-ec0166a35be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:32.548155 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29ff94-c648-494f-9fe8-ec0166a35be5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:32.548651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29ff94-c648-494f-9fe8-ec0166a35be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:32.549133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29ff94-c648-494f-9fe8-ec0166a35be5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:32.557503 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29ff94-c648-494f-9fe8-ec0166a35be5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:32.559258 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29ff94-c648-494f-9fe8-ec0166a35be5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-0f29ff94-c648-494f-9fe8-ec0166a35be5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:32.580642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:32.582246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:32.584464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:32.584464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:32.584464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:32.584464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:32.584464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:32.584464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:32.584464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:32.584464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:32.586104 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb8a38-1e4b-4bdf-9950-c59767d02374 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:32.587017 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 435/852] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:32.587689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29ff94-c648-494f-9fe8-ec0166a35be5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:32.626334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb5a57-d5ee-4458-9459-a135c762c260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:32.627398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb5a57-d5ee-4458-9459-a135c762c260 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:32.627909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb5a57-d5ee-4458-9459-a135c762c260 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:32.628392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb5a57-d5ee-4458-9459-a135c762c260 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:32.629309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb5a57-d5ee-4458-9459-a135c762c260 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:32.629848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb5a57-d5ee-4458-9459-a135c762c260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:32.631466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb5a57-d5ee-4458-9459-a135c762c260 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:32.642266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 418/853] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 11 14:00:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:32.643455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb5a57-d5ee-4458-9459-a135c762c260 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:32.681822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:32.728392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29ff94-c648-494f-9fe8-ec0166a35be5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:32.740291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:32.768685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db35e9-e217-45b7-9dd0-a04de2731500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:32.769274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db35e9-e217-45b7-9dd0-a04de2731500 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:32.769565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db35e9-e217-45b7-9dd0-a04de2731500 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:32.769846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db35e9-e217-45b7-9dd0-a04de2731500 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:32.771503 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db35e9-e217-45b7-9dd0-a04de2731500 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:32.771821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db35e9-e217-45b7-9dd0-a04de2731500 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:32.774284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db35e9-e217-45b7-9dd0-a04de2731500 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:32.784752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb5a57-d5ee-4458-9459-a135c762c260 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:32.794239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 436/854] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:32.799514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db35e9-e217-45b7-9dd0-a04de2731500 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:32.839592 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717cab12-c210-49d4-bcbf-8956e9789f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:32.841569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cab12-c210-49d4-bcbf-8956e9789f3d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:32.842063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cab12-c210-49d4-bcbf-8956e9789f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:32.842565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717cab12-c210-49d4-bcbf-8956e9789f3d None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:32.843507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cab12-c210-49d4-bcbf-8956e9789f3d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:32.844019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cab12-c210-49d4-bcbf-8956e9789f3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:32.846183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717cab12-c210-49d4-bcbf-8956e9789f3d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:32.859940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 419/855] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 11 14:00:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:32.926110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db35e9-e217-45b7-9dd0-a04de2731500 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:32.957615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:32.968595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce420d17-8f17-45e8-aa6c-57c90208dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:32.969280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420d17-8f17-45e8-aa6c-57c90208dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:32.969565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420d17-8f17-45e8-aa6c-57c90208dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:32.969841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420d17-8f17-45e8-aa6c-57c90208dbb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:32.970741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce420d17-8f17-45e8-aa6c-57c90208dbb0 None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=945586c90ac148b8880b9ad6409b02f5) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:32.971056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce420d17-8f17-45e8-aa6c-57c90208dbb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:32.972517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce420d17-8f17-45e8-aa6c-57c90208dbb0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:32.980683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 437/856] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:32 2022] GET /identity/v3/role_assignments?user.id=945586c90ac148b8880b9ad6409b02f5&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=57f1335a97b5490cb0853894c2faf62c => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:33.234846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74e3e1-dcc6-4996-81b4-fdc1a030935d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:33.235135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74e3e1-dcc6-4996-81b4-fdc1a030935d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:33.235475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74e3e1-dcc6-4996-81b4-fdc1a030935d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:33.236860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 420/857] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:33.242529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304f3e8-3707-4886-905c-08596f76fc77 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:33.242829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304f3e8-3707-4886-905c-08596f76fc77 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:33.243113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304f3e8-3707-4886-905c-08596f76fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:33.260158 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e304f3e8-3707-4886-905c-08596f76fc77 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:33.261408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e304f3e8-3707-4886-905c-08596f76fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:33.336796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 438/858] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:33.360660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74e3e1-dcc6-4996-81b4-fdc1a030935d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:33.478833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74e3e1-dcc6-4996-81b4-fdc1a030935d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:33.516282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0d2a4-66ef-4f35-afc7-b33ff65f01b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:33.517081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0d2a4-66ef-4f35-afc7-b33ff65f01b6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:33.517367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0d2a4-66ef-4f35-afc7-b33ff65f01b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:33.517642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0d2a4-66ef-4f35-afc7-b33ff65f01b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:33.519535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:33.530062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0d2a4-66ef-4f35-afc7-b33ff65f01b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-63a0d2a4-66ef-4f35-afc7-b33ff65f01b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:33.538986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:33.539947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:33.540772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 421/859] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:00:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:33.546609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304f3e8-3707-4886-905c-08596f76fc77 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:33.658439 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304f3e8-3707-4886-905c-08596f76fc77 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:33.681127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:33.696538 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad5c1a-c574-4a37-b9bb-86ab56089314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:33.697267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad5c1a-c574-4a37-b9bb-86ab56089314 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:33.697555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad5c1a-c574-4a37-b9bb-86ab56089314 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:33.697831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad5c1a-c574-4a37-b9bb-86ab56089314 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:33.698631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad5c1a-c574-4a37-b9bb-86ab56089314 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:33.698937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad5c1a-c574-4a37-b9bb-86ab56089314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:33.700303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad5c1a-c574-4a37-b9bb-86ab56089314 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:33.709133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 439/860] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:33.715293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0d2a4-66ef-4f35-afc7-b33ff65f01b6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:33.826732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0d2a4-66ef-4f35-afc7-b33ff65f01b6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:33.861062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaddaf-e2dc-4d23-bcd2-3c7162324bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:33.861858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaddaf-e2dc-4d23-bcd2-3c7162324bda None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:33.862138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaddaf-e2dc-4d23-bcd2-3c7162324bda None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:33.862446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaddaf-e2dc-4d23-bcd2-3c7162324bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:33.874144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaddaf-e2dc-4d23-bcd2-3c7162324bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:33.875649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaddaf-e2dc-4d23-bcd2-3c7162324bda None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-24eaddaf-e2dc-4d23-bcd2-3c7162324bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:33.897744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:33.899834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:33.900966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:33.900966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:33.900966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:33.900966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:33.900966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 422/861] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:33.905032 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad5c1a-c574-4a37-b9bb-86ab56089314 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:33.939730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67459fa3-c613-4513-8680-b0c7c92832ad None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:33.940077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67459fa3-c613-4513-8680-b0c7c92832ad None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:33.940294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67459fa3-c613-4513-8680-b0c7c92832ad None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:33.941774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 423/862] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:33.947730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb508be-3052-495d-abc2-6743e040d3f8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:33.948023 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb508be-3052-495d-abc2-6743e040d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:33.948191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb508be-3052-495d-abc2-6743e040d3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:33.966132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-2fb508be-3052-495d-abc2-6743e040d3f8 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:33.967704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2fb508be-3052-495d-abc2-6743e040d3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:34.015487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:34.039507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad5c1a-c574-4a37-b9bb-86ab56089314 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:34.045545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 424/863] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:34.068741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb508be-3052-495d-abc2-6743e040d3f8 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:34.078360 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8073eb8-97bc-4600-97c5-04ffdda64881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:34.078966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8073eb8-97bc-4600-97c5-04ffdda64881 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:34.079252 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8073eb8-97bc-4600-97c5-04ffdda64881 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:34.080020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8073eb8-97bc-4600-97c5-04ffdda64881 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:34.080763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8073eb8-97bc-4600-97c5-04ffdda64881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:34.081484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8073eb8-97bc-4600-97c5-04ffdda64881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:34.083154 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8073eb8-97bc-4600-97c5-04ffdda64881 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:34.100145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 440/864] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:34.106491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8073eb8-97bc-4600-97c5-04ffdda64881 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:34.161779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:34.193669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb508be-3052-495d-abc2-6743e040d3f8 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:34.239551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8073eb8-97bc-4600-97c5-04ffdda64881 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:34.239950 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3f550-38de-4f9d-8d9b-5656692c262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:34.240715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f550-38de-4f9d-8d9b-5656692c262b None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:34.241612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f550-38de-4f9d-8d9b-5656692c262b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:34.241952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3f550-38de-4f9d-8d9b-5656692c262b None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:34.242848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3f550-38de-4f9d-8d9b-5656692c262b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:34.244548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3f550-38de-4f9d-8d9b-5656692c262b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:34.266278 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 425/865] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 14:00:34 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:34.288815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13531e-a488-45e2-be9a-519e78f5433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:34.289986 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13531e-a488-45e2-be9a-519e78f5433b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:34.290497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13531e-a488-45e2-be9a-519e78f5433b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:34.290979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13531e-a488-45e2-be9a-519e78f5433b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:34.299973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13531e-a488-45e2-be9a-519e78f5433b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:34.301787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13531e-a488-45e2-be9a-519e78f5433b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-1d13531e-a488-45e2-be9a-519e78f5433b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:34.319694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:34.320854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:34.321816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:34.321816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:34.321816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:34.321816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:34.321816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:34.321816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:34.321816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:34.321816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:34.321816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:34.321816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:34.324324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 441/866] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 11 14:00:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:34.330873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3f550-38de-4f9d-8d9b-5656692c262b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:34.371639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:34.450086 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3f550-38de-4f9d-8d9b-5656692c262b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:34.486332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b91c9-73fd-4784-9efe-2aa8394ea97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:34.487013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b91c9-73fd-4784-9efe-2aa8394ea97a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:34.487294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b91c9-73fd-4784-9efe-2aa8394ea97a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:34.487571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b91c9-73fd-4784-9efe-2aa8394ea97a None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:34.488438 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b91c9-73fd-4784-9efe-2aa8394ea97a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:34.488733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b91c9-73fd-4784-9efe-2aa8394ea97a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:34.490192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b91c9-73fd-4784-9efe-2aa8394ea97a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:34.514367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 426/867] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Jul 11 14:00:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:34.515771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13531e-a488-45e2-be9a-519e78f5433b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:34.634632 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:34.640743 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13531e-a488-45e2-be9a-519e78f5433b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:34.685672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995f663-4f41-4569-bfc5-973d0aa4f18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:34.685672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995f663-4f41-4569-bfc5-973d0aa4f18e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:34.685672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995f663-4f41-4569-bfc5-973d0aa4f18e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:34.685672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995f663-4f41-4569-bfc5-973d0aa4f18e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:34.757605 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995f663-4f41-4569-bfc5-973d0aa4f18e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:34.759114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995f663-4f41-4569-bfc5-973d0aa4f18e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:34.866553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:34.874267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 442/868] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:34 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:00:34.876248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b91c9-73fd-4784-9efe-2aa8394ea97a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:34.975569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:34.982851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b91c9-73fd-4784-9efe-2aa8394ea97a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:35.016371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78735027-359c-494b-a135-c1c2c29f69ad None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.016705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78735027-359c-494b-a135-c1c2c29f69ad None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.016937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78735027-359c-494b-a135-c1c2c29f69ad None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.018610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 443/869] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:35.023556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b68916-96ff-4ea4-a1ba-94cef968ad0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:35.024358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b68916-96ff-4ea4-a1ba-94cef968ad0a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.024637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b68916-96ff-4ea4-a1ba-94cef968ad0a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.024910 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b68916-96ff-4ea4-a1ba-94cef968ad0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.028534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc4261-1b42-4b70-ac65-ca465286c66b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.029081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc4261-1b42-4b70-ac65-ca465286c66b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.029557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc4261-1b42-4b70-ac65-ca465286c66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.036579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b68916-96ff-4ea4-a1ba-94cef968ad0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:35.039608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b68916-96ff-4ea4-a1ba-94cef968ad0a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:35.051000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-37dc4261-1b42-4b70-ac65-ca465286c66b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:35.052596 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-37dc4261-1b42-4b70-ac65-ca465286c66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-35b68916-96ff-4ea4-a1ba-94cef968ad0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:35.063908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:35.064827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:35.065729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:35.065729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:35.065729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:35.065729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:35.072819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 427/870] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:35.074624 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b68916-96ff-4ea4-a1ba-94cef968ad0a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:35.135871 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 444/871] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:35.158936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc4261-1b42-4b70-ac65-ca465286c66b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:35.201307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b68916-96ff-4ea4-a1ba-94cef968ad0a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:35.238639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3730daa-4b95-4524-9252-37c9e5a863d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:35.239244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730daa-4b95-4524-9252-37c9e5a863d0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.239527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730daa-4b95-4524-9252-37c9e5a863d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.239803 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730daa-4b95-4524-9252-37c9e5a863d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.240532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3730daa-4b95-4524-9252-37c9e5a863d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:35.246810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3730daa-4b95-4524-9252-37c9e5a863d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:35.248202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3730daa-4b95-4524-9252-37c9e5a863d0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:35.265188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 428/872] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:35.265188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881318-1e55-4dd2-9cc3-fa9d91daa72b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.265188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881318-1e55-4dd2-9cc3-fa9d91daa72b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.265188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb881318-1e55-4dd2-9cc3-fa9d91daa72b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.265188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 429/873] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:35.268180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb881318-1e55-4dd2-9cc3-fa9d91daa72b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:35.276964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc4261-1b42-4b70-ac65-ca465286c66b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:35.279629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:35.311069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:35.322104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c024aa-5d40-46a3-ae55-c966e9171f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:35.323084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c024aa-5d40-46a3-ae55-c966e9171f0d None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.323367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c024aa-5d40-46a3-ae55-c966e9171f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.323633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c024aa-5d40-46a3-ae55-c966e9171f0d None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.324518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c024aa-5d40-46a3-ae55-c966e9171f0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:35.326185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c024aa-5d40-46a3-ae55-c966e9171f0d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:35.343307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 445/874] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 14:00:35 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:00:35.344700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0355eb3-37f0-4921-b41f-dcc4eb65e8fa None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.344996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0355eb3-37f0-4921-b41f-dcc4eb65e8fa None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.345276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0355eb3-37f0-4921-b41f-dcc4eb65e8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.375108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a0355eb3-37f0-4921-b41f-dcc4eb65e8fa None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:35.376364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a0355eb3-37f0-4921-b41f-dcc4eb65e8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:35.403942 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb881318-1e55-4dd2-9cc3-fa9d91daa72b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:35.454325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f4558-c1f0-4701-99d9-d4abcb197397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:35.455621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4558-c1f0-4701-99d9-d4abcb197397 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.456161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4558-c1f0-4701-99d9-d4abcb197397 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.456641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f4558-c1f0-4701-99d9-d4abcb197397 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.465638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f4558-c1f0-4701-99d9-d4abcb197397 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:35.467815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f4558-c1f0-4701-99d9-d4abcb197397 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:35.484718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 446/875] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-935f4558-c1f0-4701-99d9-d4abcb197397 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:35.487586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:35.488580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:35.489562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:35.489562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:35.489562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:35.489562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:35.489562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:35.489562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:35.489562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:35.489562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:35.496486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 430/876] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:35.497603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0355eb3-37f0-4921-b41f-dcc4eb65e8fa None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:35.509137 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f4558-c1f0-4701-99d9-d4abcb197397 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:35.604603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:35.651695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0355eb3-37f0-4921-b41f-dcc4eb65e8fa None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:35.655893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f4558-c1f0-4701-99d9-d4abcb197397 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:35.674727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:35.703636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4268b-4cac-4cc8-b429-07bdf9f4108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:35.704319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4268b-4cac-4cc8-b429-07bdf9f4108a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.704606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4268b-4cac-4cc8-b429-07bdf9f4108a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.704904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4268b-4cac-4cc8-b429-07bdf9f4108a None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.705791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4268b-4cac-4cc8-b429-07bdf9f4108a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:35.706108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4268b-4cac-4cc8-b429-07bdf9f4108a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:35.706754 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b95a3-599a-44e2-9f70-85e12aaa56e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:35.707597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4268b-4cac-4cc8-b429-07bdf9f4108a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:35.708016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b95a3-599a-44e2-9f70-85e12aaa56e8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.708551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b95a3-599a-44e2-9f70-85e12aaa56e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.709021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b95a3-599a-44e2-9f70-85e12aaa56e8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.710894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b95a3-599a-44e2-9f70-85e12aaa56e8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:35.712992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b95a3-599a-44e2-9f70-85e12aaa56e8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:35.729595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 447/877] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:35.731353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4268b-4cac-4cc8-b429-07bdf9f4108a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4d2b95a3-599a-44e2-9f70-85e12aaa56e8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:35.736358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:35.737432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:35.738294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 431/878] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 11 14:00:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:35.745111 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b95a3-599a-44e2-9f70-85e12aaa56e8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:35.868676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4268b-4cac-4cc8-b429-07bdf9f4108a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:35.873196 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b95a3-599a-44e2-9f70-85e12aaa56e8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:35.908843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:35.922385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db0ad8-5706-4dbe-afeb-122ca17337a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:35.923432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0ad8-5706-4dbe-afeb-122ca17337a0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.923904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0ad8-5706-4dbe-afeb-122ca17337a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.924439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0ad8-5706-4dbe-afeb-122ca17337a0 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.924827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe1ef0-3fa5-48c5-a7ef-c51a6e80e510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:35.925565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe1ef0-3fa5-48c5-a7ef-c51a6e80e510 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:35.925796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db0ad8-5706-4dbe-afeb-122ca17337a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:35.926202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe1ef0-3fa5-48c5-a7ef-c51a6e80e510 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:35.926523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db0ad8-5706-4dbe-afeb-122ca17337a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:35.926972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe1ef0-3fa5-48c5-a7ef-c51a6e80e510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:35.928038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe1ef0-3fa5-48c5-a7ef-c51a6e80e510 None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=d1dd32e8fdec4ea989cc2e83f18944f4) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:35.928459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe1ef0-3fa5-48c5-a7ef-c51a6e80e510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:35.928763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db0ad8-5706-4dbe-afeb-122ca17337a0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:35.930647 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe1ef0-3fa5-48c5-a7ef-c51a6e80e510 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:35.940156 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 448/879] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:35 2022] GET /identity/v3/role_assignments?user.id=d1dd32e8fdec4ea989cc2e83f18944f4&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:35.941899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 432/880] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Jul 11 14:00:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:35.942323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe1ef0-3fa5-48c5-a7ef-c51a6e80e510 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:36.007945 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:36.087077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe1ef0-3fa5-48c5-a7ef-c51a6e80e510 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:36.129526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9787-b011-4c78-a6a8-67d566b2cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:36.130750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9787-b011-4c78-a6a8-67d566b2cfba None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:36.131095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9787-b011-4c78-a6a8-67d566b2cfba None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:36.131403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9787-b011-4c78-a6a8-67d566b2cfba None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:36.132913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca9787-b011-4c78-a6a8-67d566b2cfba None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:36.133223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca9787-b011-4c78-a6a8-67d566b2cfba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:36.134639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca9787-b011-4c78-a6a8-67d566b2cfba None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:36.140109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 449/881] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Jul 11 14:00:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:36.604144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6694-36dc-405d-9861-40a389d9f715 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:36.604539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6694-36dc-405d-9861-40a389d9f715 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:36.604748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6694-36dc-405d-9861-40a389d9f715 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:36.606393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 433/882] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:36.611696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f7dc-7a6c-459d-8494-7b8bee7d3c14 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:36.611990 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f7dc-7a6c-459d-8494-7b8bee7d3c14 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:36.612272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53f7dc-7a6c-459d-8494-7b8bee7d3c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:36.630565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-cc53f7dc-7a6c-459d-8494-7b8bee7d3c14 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:36.631955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cc53f7dc-7a6c-459d-8494-7b8bee7d3c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:36.706271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 450/883] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:36.725789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd6694-36dc-405d-9861-40a389d9f715 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:36.845063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd6694-36dc-405d-9861-40a389d9f715 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:36.882181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f591-b8a8-4be2-8958-738a133d282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:36.882970 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f591-b8a8-4be2-8958-738a133d282b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:36.883248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f591-b8a8-4be2-8958-738a133d282b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:36.883519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f591-b8a8-4be2-8958-738a133d282b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:36.884179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41f591-b8a8-4be2-8958-738a133d282b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:36.885566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41f591-b8a8-4be2-8958-738a133d282b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-fe41f591-b8a8-4be2-8958-738a133d282b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:36.899259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:36.900304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:36.901157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 434/884] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 14:00:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:36.906871 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53f7dc-7a6c-459d-8494-7b8bee7d3c14 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:36.946037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:37.016688 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53f7dc-7a6c-459d-8494-7b8bee7d3c14 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:37.057191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1919006-ccd9-4d99-b2ec-5629f41f355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:37.057905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919006-ccd9-4d99-b2ec-5629f41f355e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:37.058235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919006-ccd9-4d99-b2ec-5629f41f355e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:37.058520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1919006-ccd9-4d99-b2ec-5629f41f355e None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:37.059276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1919006-ccd9-4d99-b2ec-5629f41f355e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:37.059611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1919006-ccd9-4d99-b2ec-5629f41f355e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:37.061055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1919006-ccd9-4d99-b2ec-5629f41f355e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:37.066530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 451/885] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 14:00:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:37.072049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f591-b8a8-4be2-8958-738a133d282b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:37.131842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:37.182331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f591-b8a8-4be2-8958-738a133d282b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:37.232012 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e067-4ac7-43ef-9957-a705ddb20c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:37.232755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e067-4ac7-43ef-9957-a705ddb20c0c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:37.233044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e067-4ac7-43ef-9957-a705ddb20c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:37.233358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e067-4ac7-43ef-9957-a705ddb20c0c None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:37.234092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9e067-4ac7-43ef-9957-a705ddb20c0c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:37.234432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9e067-4ac7-43ef-9957-a705ddb20c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:37.235826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9e067-4ac7-43ef-9957-a705ddb20c0c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:37.241421 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 435/886] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 14:00:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:37.247359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1919006-ccd9-4d99-b2ec-5629f41f355e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:37.359425 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:37.363518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1919006-ccd9-4d99-b2ec-5629f41f355e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:37.402092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8fbc1-d926-4947-ba80-23fc86afbda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:37.402805 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8fbc1-d926-4947-ba80-23fc86afbda1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:37.403092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8fbc1-d926-4947-ba80-23fc86afbda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:37.403373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8fbc1-d926-4947-ba80-23fc86afbda1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:37.404177 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8fbc1-d926-4947-ba80-23fc86afbda1 None admin] RBAC: Adding query filter params (interface=public, service_id=e6d3ec4dff0c4b4c8d6a5d954354bccc, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:37.404490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8fbc1-d926-4947-ba80-23fc86afbda1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:37.405861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8fbc1-d926-4947-ba80-23fc86afbda1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:37.415946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 452/887] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 11 14:00:37 2022] GET /identity/v3/endpoints?service_id=e6d3ec4dff0c4b4c8d6a5d954354bccc&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:37.417431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e067-4ac7-43ef-9957-a705ddb20c0c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:37.527332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e067-4ac7-43ef-9957-a705ddb20c0c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:37.546008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:37.564834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e447e-d1c1-40e7-9d2f-da6a12d84a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:37.565827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e447e-d1c1-40e7-9d2f-da6a12d84a2b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:37.566358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e447e-d1c1-40e7-9d2f-da6a12d84a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:37.566843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e447e-d1c1-40e7-9d2f-da6a12d84a2b None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:37.567833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e447e-d1c1-40e7-9d2f-da6a12d84a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:37.569440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e447e-d1c1-40e7-9d2f-da6a12d84a2b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:37.575855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 436/888] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 11 14:00:37 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:00:37.799901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb1380-1292-46b5-8dcf-a4f1a1fb77fa None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:37.800485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb1380-1292-46b5-8dcf-a4f1a1fb77fa None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:37.800485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb1380-1292-46b5-8dcf-a4f1a1fb77fa None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:37.801713 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 453/889] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:37.808059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5acc-d0fe-48fb-8da2-5ac0e58402d7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:37.808426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5acc-d0fe-48fb-8da2-5ac0e58402d7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:37.808695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5acc-d0fe-48fb-8da2-5ac0e58402d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:37.827232 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-197e5acc-d0fe-48fb-8da2-5ac0e58402d7 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:37.828446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-197e5acc-d0fe-48fb-8da2-5ac0e58402d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:37.901964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 437/890] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:37.924759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb1380-1292-46b5-8dcf-a4f1a1fb77fa None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:38.062330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb1380-1292-46b5-8dcf-a4f1a1fb77fa None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:38.110375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26064f-5c0c-4ae3-a71a-22d421faa865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:38.111214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26064f-5c0c-4ae3-a71a-22d421faa865 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:38.111501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26064f-5c0c-4ae3-a71a-22d421faa865 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:38.111781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26064f-5c0c-4ae3-a71a-22d421faa865 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:38.112456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26064f-5c0c-4ae3-a71a-22d421faa865 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:38.113846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26064f-5c0c-4ae3-a71a-22d421faa865 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-3a26064f-5c0c-4ae3-a71a-22d421faa865 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:38.127454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:38.128506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:38.129418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 454/891] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Jul 11 14:00:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:38.137568 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e5acc-d0fe-48fb-8da2-5ac0e58402d7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:38.257589 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e5acc-d0fe-48fb-8da2-5ac0e58402d7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:38.271674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:38.294340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4501a-47c3-45ef-9f01-f24564e2bca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:38.294684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58b8d-b665-4d5f-a1ab-e61543453d8e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:38.294910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58b8d-b665-4d5f-a1ab-e61543453d8e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:38.295020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4501a-47c3-45ef-9f01-f24564e2bca4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:38.295201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b58b8d-b665-4d5f-a1ab-e61543453d8e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:38.295308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4501a-47c3-45ef-9f01-f24564e2bca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:38.295553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4501a-47c3-45ef-9f01-f24564e2bca4 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:38.296340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4501a-47c3-45ef-9f01-f24564e2bca4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:38.296650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4501a-47c3-45ef-9f01-f24564e2bca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:38.296827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 455/892] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:00:38.298175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4501a-47c3-45ef-9f01-f24564e2bca4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:38.301853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf1ef5-e0a7-461e-b11f-c2d04bf20738 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:38.302150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf1ef5-e0a7-461e-b11f-c2d04bf20738 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:38.302473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf1ef5-e0a7-461e-b11f-c2d04bf20738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:38.303875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 438/893] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 11 14:00:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:38.309482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4501a-47c3-45ef-9f01-f24564e2bca4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:38.325005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5edf1ef5-e0a7-461e-b11f-c2d04bf20738 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:38.326727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5edf1ef5-e0a7-461e-b11f-c2d04bf20738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:38.354810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:38.422288 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4501a-47c3-45ef-9f01-f24564e2bca4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:38.426467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 456/894] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:38.427650 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ee24-af28-43f7-8c40-9b811725abb5 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:38.427941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ee24-af28-43f7-8c40-9b811725abb5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:38.428296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d1ee24-af28-43f7-8c40-9b811725abb5 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:38.430721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 457/895] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:38.435707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096394b8-7ec2-4db4-b55f-940f03be53f0 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:38.435996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096394b8-7ec2-4db4-b55f-940f03be53f0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:38.436280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096394b8-7ec2-4db4-b55f-940f03be53f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:38.453469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-096394b8-7ec2-4db4-b55f-940f03be53f0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:38.454693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-096394b8-7ec2-4db4-b55f-940f03be53f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:38.467381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2f0f2-805d-4a0e-90ba-5844b4fdc1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:38.468416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2f0f2-805d-4a0e-90ba-5844b4fdc1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:38.468861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2f0f2-805d-4a0e-90ba-5844b4fdc1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:38.469430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2f0f2-805d-4a0e-90ba-5844b4fdc1b4 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:38.470685 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2f0f2-805d-4a0e-90ba-5844b4fdc1b4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:38.471403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2f0f2-805d-4a0e-90ba-5844b4fdc1b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:38.473367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2f0f2-805d-4a0e-90ba-5844b4fdc1b4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:38.479626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 439/896] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 11 14:00:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:38.484849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2f0f2-805d-4a0e-90ba-5844b4fdc1b4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:38.528975 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:38.534550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 458/897] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:38.534550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096394b8-7ec2-4db4-b55f-940f03be53f0 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:38.598072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2f0f2-805d-4a0e-90ba-5844b4fdc1b4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:38.633360 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:38.635494 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319f678-dd77-477a-bdb3-f9d29562558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:38.636680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319f678-dd77-477a-bdb3-f9d29562558c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:38.637135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319f678-dd77-477a-bdb3-f9d29562558c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:38.637437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319f678-dd77-477a-bdb3-f9d29562558c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:38.648755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096394b8-7ec2-4db4-b55f-940f03be53f0 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:38.648991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319f678-dd77-477a-bdb3-f9d29562558c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c319f678-dd77-477a-bdb3-f9d29562558c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:38.657211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:38.658428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 440/898] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Jul 11 14:00:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:38.664955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319f678-dd77-477a-bdb3-f9d29562558c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:38.690560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a683a-a8ba-4316-8e90-9a9bdb4d7da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:38.691655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a683a-a8ba-4316-8e90-9a9bdb4d7da0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:38.692130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a683a-a8ba-4316-8e90-9a9bdb4d7da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:38.692415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a683a-a8ba-4316-8e90-9a9bdb4d7da0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:38.693221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a683a-a8ba-4316-8e90-9a9bdb4d7da0 None admin] RBAC: Adding query filter params (interface=public, service_id=30a91590f102436493f7805947868113, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:38.693544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a683a-a8ba-4316-8e90-9a9bdb4d7da0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:38.695009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a683a-a8ba-4316-8e90-9a9bdb4d7da0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:38.701234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 459/899] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 11 14:00:38 2022] GET /identity/v3/endpoints?service_id=30a91590f102436493f7805947868113&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:38.701802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a683a-a8ba-4316-8e90-9a9bdb4d7da0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:38.774577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:38.779473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319f678-dd77-477a-bdb3-f9d29562558c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:38.814633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a683a-a8ba-4316-8e90-9a9bdb4d7da0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:38.823203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725c514-bdcc-4cfc-810c-7c296c8ee55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:38.823883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725c514-bdcc-4cfc-810c-7c296c8ee55d None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:38.824161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725c514-bdcc-4cfc-810c-7c296c8ee55d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:38.824486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725c514-bdcc-4cfc-810c-7c296c8ee55d None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:38.825166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725c514-bdcc-4cfc-810c-7c296c8ee55d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:38.826590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725c514-bdcc-4cfc-810c-7c296c8ee55d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:38.842382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 441/900] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 14:00:38 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:38.843317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725c514-bdcc-4cfc-810c-7c296c8ee55d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:38.887544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5a47c-d8bd-48e5-ac15-02d671a24510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:38.888570 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5a47c-d8bd-48e5-ac15-02d671a24510 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:38.889254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5a47c-d8bd-48e5-ac15-02d671a24510 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:38.889946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5a47c-d8bd-48e5-ac15-02d671a24510 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:38.891142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5a47c-d8bd-48e5-ac15-02d671a24510 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:38.891676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5a47c-d8bd-48e5-ac15-02d671a24510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:38.893291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5a47c-d8bd-48e5-ac15-02d671a24510 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:38.904103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 460/901] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Jul 11 14:00:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:38.912089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5a47c-d8bd-48e5-ac15-02d671a24510 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:38.927236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:39.015764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725c514-bdcc-4cfc-810c-7c296c8ee55d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:39.043189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5a47c-d8bd-48e5-ac15-02d671a24510 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:39.060937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342d9f0-250d-45d3-bea0-89e5c884f5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:39.061615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342d9f0-250d-45d3-bea0-89e5c884f5ac None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:39.061899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342d9f0-250d-45d3-bea0-89e5c884f5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:39.063788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342d9f0-250d-45d3-bea0-89e5c884f5ac None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:39.063788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342d9f0-250d-45d3-bea0-89e5c884f5ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:39.064448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342d9f0-250d-45d3-bea0-89e5c884f5ac None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:39.071694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 442/902] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 11 14:00:38 2022] GET /identity/v3/services => generated 1497 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:00:39.085839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a75c9-2c97-495b-bff8-3a5ddd4a0442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:39.086714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a75c9-2c97-495b-bff8-3a5ddd4a0442 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:39.087000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a75c9-2c97-495b-bff8-3a5ddd4a0442 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:39.087280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a75c9-2c97-495b-bff8-3a5ddd4a0442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:39.100825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a75c9-2c97-495b-bff8-3a5ddd4a0442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:39.102342 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a75c9-2c97-495b-bff8-3a5ddd4a0442 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8c1a75c9-2c97-495b-bff8-3a5ddd4a0442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:39.122441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:39.123437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:39.124356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:39.124356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:39.124356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:39.124356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:39.124356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 461/903] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:39.129515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342d9f0-250d-45d3-bea0-89e5c884f5ac None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:39.161463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:39.257126 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342d9f0-250d-45d3-bea0-89e5c884f5ac None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:39.295266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f3c14-67d9-40f6-8bb6-27f51f76958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:39.295939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3c14-67d9-40f6-8bb6-27f51f76958b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:39.296227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3c14-67d9-40f6-8bb6-27f51f76958b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:39.296593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3c14-67d9-40f6-8bb6-27f51f76958b None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:39.297330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f3c14-67d9-40f6-8bb6-27f51f76958b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:39.297639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f3c14-67d9-40f6-8bb6-27f51f76958b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:39.299058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f3c14-67d9-40f6-8bb6-27f51f76958b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:39.312017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 443/904] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:39.317122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a75c9-2c97-495b-bff8-3a5ddd4a0442 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:39.388558 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:39.433485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a75c9-2c97-495b-bff8-3a5ddd4a0442 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:39.469069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18f897-73e3-402a-ae8a-bc955ae02b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:39.469889 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f897-73e3-402a-ae8a-bc955ae02b7f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:39.470188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f897-73e3-402a-ae8a-bc955ae02b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:39.470477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f897-73e3-402a-ae8a-bc955ae02b7f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:39.478898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18f897-73e3-402a-ae8a-bc955ae02b7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:39.480347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18f897-73e3-402a-ae8a-bc955ae02b7f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-ea18f897-73e3-402a-ae8a-bc955ae02b7f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:39.496479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:39.497511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:39.498827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:39.498827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:39.498827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:39.498827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:39.498827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:39.498827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:39.498827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:39.498827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:39.498827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:39.498827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:39.498827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 462/905] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 11 14:00:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:39.503674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f3c14-67d9-40f6-8bb6-27f51f76958b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:39.596435 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:39.614867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f3c14-67d9-40f6-8bb6-27f51f76958b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:39.653678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea33896-0f92-4f78-afaa-71a58e1a4c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:39.654686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea33896-0f92-4f78-afaa-71a58e1a4c48 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:39.655114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea33896-0f92-4f78-afaa-71a58e1a4c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:39.655532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea33896-0f92-4f78-afaa-71a58e1a4c48 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:39.656533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea33896-0f92-4f78-afaa-71a58e1a4c48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:39.656994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea33896-0f92-4f78-afaa-71a58e1a4c48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:39.658664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea33896-0f92-4f78-afaa-71a58e1a4c48 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:39.679858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 444/906] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Jul 11 14:00:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:39.685445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18f897-73e3-402a-ae8a-bc955ae02b7f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:39.794088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18f897-73e3-402a-ae8a-bc955ae02b7f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:39.803615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416c4e1-712f-4f31-ba5d-b8d63ca07a6a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:39.804003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416c4e1-712f-4f31-ba5d-b8d63ca07a6a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:39.804296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416c4e1-712f-4f31-ba5d-b8d63ca07a6a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:39.805996 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 445/907] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:39.811625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2616a-e2ca-4cbc-8f2a-427a14c55a71 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:39.811918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2616a-e2ca-4cbc-8f2a-427a14c55a71 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:39.812198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2616a-e2ca-4cbc-8f2a-427a14c55a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:39.821968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:39.831863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-31f2616a-e2ca-4cbc-8f2a-427a14c55a71 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:39.833355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-31f2616a-e2ca-4cbc-8f2a-427a14c55a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:39.833969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38946c-d707-4c19-984b-5a7a5a557b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:39.834968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38946c-d707-4c19-984b-5a7a5a557b10 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:39.835405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38946c-d707-4c19-984b-5a7a5a557b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:39.835693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38946c-d707-4c19-984b-5a7a5a557b10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:39.911196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38946c-d707-4c19-984b-5a7a5a557b10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:39.913686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38946c-d707-4c19-984b-5a7a5a557b10 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:39.921215 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 446/908] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:39.946577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2616a-e2ca-4cbc-8f2a-427a14c55a71 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:40.022785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:40.024225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 463/909] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:39 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:00:40.032090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38946c-d707-4c19-984b-5a7a5a557b10 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:40.058406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:40.067887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2616a-e2ca-4cbc-8f2a-427a14c55a71 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:40.114016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ef320-b58a-42f9-b188-71011d7e1af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:40.114879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ef320-b58a-42f9-b188-71011d7e1af8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:40.115163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ef320-b58a-42f9-b188-71011d7e1af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:40.115440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ef320-b58a-42f9-b188-71011d7e1af8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:40.116938 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ef320-b58a-42f9-b188-71011d7e1af8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:40.118701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ef320-b58a-42f9-b188-71011d7e1af8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-cd5ef320-b58a-42f9-b188-71011d7e1af8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:40.133788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:40.134853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 11 14:00:40.135684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:40.138933 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 447/910] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 14:00:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:40.145345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ef320-b58a-42f9-b188-71011d7e1af8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:40.154584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38946c-d707-4c19-984b-5a7a5a557b10 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:40.191341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e5153-e223-4edd-aff4-9f82f71752ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:40.192571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5153-e223-4edd-aff4-9f82f71752ec None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:40.193083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5153-e223-4edd-aff4-9f82f71752ec None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:40.193568 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e5153-e223-4edd-aff4-9f82f71752ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:40.210396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e5153-e223-4edd-aff4-9f82f71752ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:40.212239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e5153-e223-4edd-aff4-9f82f71752ec None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-019e5153-e223-4edd-aff4-9f82f71752ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:40.231298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:40.232240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:40.233160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:40.233160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:40.233160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:40.233160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:40.239785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 464/911] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:40.241419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e5153-e223-4edd-aff4-9f82f71752ec None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:40.294827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ef320-b58a-42f9-b188-71011d7e1af8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:40.323370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:40.348750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473f8af-297a-4385-93dc-3202daf81ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:40.349804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e5153-e223-4edd-aff4-9f82f71752ec None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:40.350527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f8af-297a-4385-93dc-3202daf81ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:40.351036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f8af-297a-4385-93dc-3202daf81ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:40.351521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473f8af-297a-4385-93dc-3202daf81ce4 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:40.352767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473f8af-297a-4385-93dc-3202daf81ce4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:40.354215 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473f8af-297a-4385-93dc-3202daf81ce4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:40.355817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473f8af-297a-4385-93dc-3202daf81ce4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:40.358057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:40.364335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 448/912] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 14:00:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:40.370946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473f8af-297a-4385-93dc-3202daf81ce4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:40.388437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89ea94-4f62-43d5-adec-a33780042e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:40.389195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89ea94-4f62-43d5-adec-a33780042e47 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:40.389545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89ea94-4f62-43d5-adec-a33780042e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:40.389894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89ea94-4f62-43d5-adec-a33780042e47 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:40.390771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89ea94-4f62-43d5-adec-a33780042e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:40.391241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89ea94-4f62-43d5-adec-a33780042e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:40.392630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89ea94-4f62-43d5-adec-a33780042e47 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:40.407489 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 465/913] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:40.413729 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89ea94-4f62-43d5-adec-a33780042e47 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:40.483060 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473f8af-297a-4385-93dc-3202daf81ce4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:40.526671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40d9d7-97c6-4f53-a21d-57b183d62838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:40.527698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40d9d7-97c6-4f53-a21d-57b183d62838 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:40.528680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40d9d7-97c6-4f53-a21d-57b183d62838 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:40.529163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40d9d7-97c6-4f53-a21d-57b183d62838 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:40.530368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40d9d7-97c6-4f53-a21d-57b183d62838 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:40.531102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40d9d7-97c6-4f53-a21d-57b183d62838 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:40.533341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40d9d7-97c6-4f53-a21d-57b183d62838 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:40.541537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89ea94-4f62-43d5-adec-a33780042e47 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:40.541811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 449/914] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Jul 11 14:00:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:40.549726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40d9d7-97c6-4f53-a21d-57b183d62838 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:40.581937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d4a37-1042-4578-bf33-38ff978d9a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:40.582923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d4a37-1042-4578-bf33-38ff978d9a4e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:40.583275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d4a37-1042-4578-bf33-38ff978d9a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:40.583639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d4a37-1042-4578-bf33-38ff978d9a4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:40.585892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:40.592742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d4a37-1042-4578-bf33-38ff978d9a4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:40.594349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d4a37-1042-4578-bf33-38ff978d9a4e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-0e3d4a37-1042-4578-bf33-38ff978d9a4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:40.610524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:40.611493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:40.612386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:40.612386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:40.612386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:40.612386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:40.612386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:40.612386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:40.612386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:40.612386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:40.614638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:40.617572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 466/915] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:40.618859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d4a37-1042-4578-bf33-38ff978d9a4e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:40.657629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40d9d7-97c6-4f53-a21d-57b183d62838 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:40.693490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efabeb-eb2e-44b3-9d44-ff2c467d6395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:40.694228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efabeb-eb2e-44b3-9d44-ff2c467d6395 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:40.694508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efabeb-eb2e-44b3-9d44-ff2c467d6395 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:40.694781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efabeb-eb2e-44b3-9d44-ff2c467d6395 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:40.695554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efabeb-eb2e-44b3-9d44-ff2c467d6395 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:40.696946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efabeb-eb2e-44b3-9d44-ff2c467d6395 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:40.723526 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 450/916] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 11 14:00:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:40.736548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d4a37-1042-4578-bf33-38ff978d9a4e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:40.783066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0af40f-6c1b-4600-b340-07d3ce9b7982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:40.783745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0af40f-6c1b-4600-b340-07d3ce9b7982 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:40.784027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0af40f-6c1b-4600-b340-07d3ce9b7982 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:40.784304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0af40f-6c1b-4600-b340-07d3ce9b7982 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:40.785114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0af40f-6c1b-4600-b340-07d3ce9b7982 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:40.785425 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0af40f-6c1b-4600-b340-07d3ce9b7982 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:40.786941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0af40f-6c1b-4600-b340-07d3ce9b7982 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:40.806434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 467/917] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:40.808755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efabeb-eb2e-44b3-9d44-ff2c467d6395 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:40.938044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efabeb-eb2e-44b3-9d44-ff2c467d6395 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:40.960474 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:40.978218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d9b62-5b75-4a36-badb-460e78c9aa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:40.978903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9b62-5b75-4a36-badb-460e78c9aa24 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:40.979184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9b62-5b75-4a36-badb-460e78c9aa24 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:40.979455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d9b62-5b75-4a36-badb-460e78c9aa24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:40.980300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d9b62-5b75-4a36-badb-460e78c9aa24 None admin] RBAC: Adding query filter params (role.id=b4157aafaef74a9fbbe56bae19de8b02, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=d1dd32e8fdec4ea989cc2e83f18944f4) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:40.980612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d9b62-5b75-4a36-badb-460e78c9aa24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:40.982045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d9b62-5b75-4a36-badb-460e78c9aa24 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:40.989908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 451/918] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:40 2022] GET /identity/v3/role_assignments?user.id=d1dd32e8fdec4ea989cc2e83f18944f4&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=b4157aafaef74a9fbbe56bae19de8b02 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:41.106813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0cfb8-d07b-4988-bb1c-9ddcd2940754 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:41.107364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0cfb8-d07b-4988-bb1c-9ddcd2940754 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:41.107364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0cfb8-d07b-4988-bb1c-9ddcd2940754 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:41.109103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 468/919] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:41.114926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12308f-4621-4da0-9663-ea3628a1e0d3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:41.115225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12308f-4621-4da0-9663-ea3628a1e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:41.115502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12308f-4621-4da0-9663-ea3628a1e0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:41.135890 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-aa12308f-4621-4da0-9663-ea3628a1e0d3 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:41.137143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-aa12308f-4621-4da0-9663-ea3628a1e0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:41.232484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 452/920] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:41.255468 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0cfb8-d07b-4988-bb1c-9ddcd2940754 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:41.305637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54214-ffef-4244-b39f-9dc262966450 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:41.306174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54214-ffef-4244-b39f-9dc262966450 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:41.306259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc54214-ffef-4244-b39f-9dc262966450 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:41.307886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 453/921] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:41.313010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cfe8c-0192-4878-b343-0611ab5f269e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:41.313297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cfe8c-0192-4878-b343-0611ab5f269e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:41.313473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:41.313577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cfe8c-0192-4878-b343-0611ab5f269e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:41.332471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a02cfe8c-0192-4878-b343-0611ab5f269e None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:41.333843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a02cfe8c-0192-4878-b343-0611ab5f269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:41.372466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0cfb8-d07b-4988-bb1c-9ddcd2940754 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:41.411050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 454/922] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:41.417215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19a475-799c-4e47-ba94-b0be2b883460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:41.418233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a475-799c-4e47-ba94-b0be2b883460 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:41.418629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a475-799c-4e47-ba94-b0be2b883460 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:41.419044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a475-799c-4e47-ba94-b0be2b883460 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:41.419813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19a475-799c-4e47-ba94-b0be2b883460 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:41.421302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19a475-799c-4e47-ba94-b0be2b883460 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:41.434984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cfe8c-0192-4878-b343-0611ab5f269e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-2d19a475-799c-4e47-ba94-b0be2b883460 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:41.436818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:41.437879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:41.438773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:41.439744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 469/923] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 11 14:00:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:41.448830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19a475-799c-4e47-ba94-b0be2b883460 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:41.495025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:41.573419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cfe8c-0192-4878-b343-0611ab5f269e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:41.575355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19a475-799c-4e47-ba94-b0be2b883460 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:41.590710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:41.614119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a74fe-c0dc-4917-a4c3-a71bb44d7c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:41.616113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a74fe-c0dc-4917-a4c3-a71bb44d7c3e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:41.616618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a74fe-c0dc-4917-a4c3-a71bb44d7c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:41.616910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f8034-2191-44b2-9303-80d58fd17be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:41.617332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a74fe-c0dc-4917-a4c3-a71bb44d7c3e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:41.617763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f8034-2191-44b2-9303-80d58fd17be0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:41.618116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f8034-2191-44b2-9303-80d58fd17be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:41.618483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f8034-2191-44b2-9303-80d58fd17be0 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:41.618853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a74fe-c0dc-4917-a4c3-a71bb44d7c3e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:41.619340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f8034-2191-44b2-9303-80d58fd17be0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:41.619718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f8034-2191-44b2-9303-80d58fd17be0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:41.620837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a74fe-c0dc-4917-a4c3-a71bb44d7c3e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:41.621298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f8034-2191-44b2-9303-80d58fd17be0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:41.632756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 470/924] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Jul 11 14:00:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:41.635131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f8034-2191-44b2-9303-80d58fd17be0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d59a74fe-c0dc-4917-a4c3-a71bb44d7c3e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:41.638704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:41.639706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 11 14:00:41.640561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:41.642226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 455/925] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Jul 11 14:00:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:41.650781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a74fe-c0dc-4917-a4c3-a71bb44d7c3e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:41.750151 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f8034-2191-44b2-9303-80d58fd17be0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:41.777750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a74fe-c0dc-4917-a4c3-a71bb44d7c3e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:41.789018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:41.797463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc139b0-7427-45f7-b507-d5e46dcdae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:41.798320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc139b0-7427-45f7-b507-d5e46dcdae73 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:41.798714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc139b0-7427-45f7-b507-d5e46dcdae73 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:41.799035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc139b0-7427-45f7-b507-d5e46dcdae73 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:41.799720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc139b0-7427-45f7-b507-d5e46dcdae73 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:41.800034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc139b0-7427-45f7-b507-d5e46dcdae73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:41.801759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc139b0-7427-45f7-b507-d5e46dcdae73 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:41.808532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 471/926] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Jul 11 14:00:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:41.815244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc139b0-7427-45f7-b507-d5e46dcdae73 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:41.825717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681d035-66f8-46e9-8a3a-55d99ddb35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:41.826756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681d035-66f8-46e9-8a3a-55d99ddb35be None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:41.827272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681d035-66f8-46e9-8a3a-55d99ddb35be None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:41.828125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681d035-66f8-46e9-8a3a-55d99ddb35be None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:41.829362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681d035-66f8-46e9-8a3a-55d99ddb35be None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:41.830194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681d035-66f8-46e9-8a3a-55d99ddb35be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:41.831945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681d035-66f8-46e9-8a3a-55d99ddb35be None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:41.844024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 456/927] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 11 14:00:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:41.845793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681d035-66f8-46e9-8a3a-55d99ddb35be None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:41.868980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:41.954358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc139b0-7427-45f7-b507-d5e46dcdae73 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:41.972404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681d035-66f8-46e9-8a3a-55d99ddb35be None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:42.003275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548db001-184b-4c76-820c-8771a617af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:42.004656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548db001-184b-4c76-820c-8771a617af5e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:42.005653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548db001-184b-4c76-820c-8771a617af5e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:42.007058 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548db001-184b-4c76-820c-8771a617af5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:42.008485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548db001-184b-4c76-820c-8771a617af5e None admin] RBAC: Adding query filter params (interface=public, service_id=03cc1af025f2472f834a44ca5f518305, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:42.009467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548db001-184b-4c76-820c-8771a617af5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:42.011734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548db001-184b-4c76-820c-8771a617af5e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:42.018187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7cf11-6404-4833-8c55-68d86cf824a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:42.018892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 472/928] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 11 14:00:41 2022] GET /identity/v3/endpoints?service_id=03cc1af025f2472f834a44ca5f518305&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:42.019005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7cf11-6404-4833-8c55-68d86cf824a1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:42.019225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7cf11-6404-4833-8c55-68d86cf824a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:42.019614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7cf11-6404-4833-8c55-68d86cf824a1 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:42.020643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7cf11-6404-4833-8c55-68d86cf824a1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:42.021040 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7cf11-6404-4833-8c55-68d86cf824a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:42.026416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7cf11-6404-4833-8c55-68d86cf824a1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:42.030544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 457/929] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 11 14:00:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:42.035293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548db001-184b-4c76-820c-8771a617af5e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:42.036478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7cf11-6404-4833-8c55-68d86cf824a1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:42.081250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:42.145652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548db001-184b-4c76-820c-8771a617af5e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:42.154233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:42.182849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7cf11-6404-4833-8c55-68d86cf824a1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:42.191183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53c74f-faef-4e41-acc1-9cefeab390a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:42.192627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53c74f-faef-4e41-acc1-9cefeab390a2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:42.193127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53c74f-faef-4e41-acc1-9cefeab390a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:42.194225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53c74f-faef-4e41-acc1-9cefeab390a2 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:42.195482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53c74f-faef-4e41-acc1-9cefeab390a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:42.197825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53c74f-faef-4e41-acc1-9cefeab390a2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:42.207245 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 473/930] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 11 14:00:42 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:00:42.225789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c12c7-ed9d-4981-90ef-a16d2a00aa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:42.226680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c12c7-ed9d-4981-90ef-a16d2a00aa60 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:42.226966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c12c7-ed9d-4981-90ef-a16d2a00aa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:42.227244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c12c7-ed9d-4981-90ef-a16d2a00aa60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:42.228091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c12c7-ed9d-4981-90ef-a16d2a00aa60 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:42.229530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c12c7-ed9d-4981-90ef-a16d2a00aa60 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:42.251709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 458/931] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 11 14:00:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:42.992010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b65ec-d544-45d4-94ad-1b2e238faa67 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:42.992399 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b65ec-d544-45d4-94ad-1b2e238faa67 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:42.992797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b65ec-d544-45d4-94ad-1b2e238faa67 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:42.994513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 474/932] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:00:43.000078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a2ab-a792-453a-ae33-3b68a897e445 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:43.000639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a2ab-a792-453a-ae33-3b68a897e445 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:43.000639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792a2ab-a792-453a-ae33-3b68a897e445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:43.018613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-1792a2ab-a792-453a-ae33-3b68a897e445 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:43.019827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1792a2ab-a792-453a-ae33-3b68a897e445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:43.106267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 459/933] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:43.123194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b65ec-d544-45d4-94ad-1b2e238faa67 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:43.168574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c53395-e878-4ba6-9bed-d8808dc3352e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:43.168887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c53395-e878-4ba6-9bed-d8808dc3352e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:43.169137 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c53395-e878-4ba6-9bed-d8808dc3352e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:43.170808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 460/934] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:00:43.182181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d193408-5729-46fe-8288-1550cf4540be None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:43.182181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d193408-5729-46fe-8288-1550cf4540be None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:43.182181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d193408-5729-46fe-8288-1550cf4540be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:43.193633 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3d193408-5729-46fe-8288-1550cf4540be None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:43.194979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3d193408-5729-46fe-8288-1550cf4540be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:43.208949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:43.249920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b65ec-d544-45d4-94ad-1b2e238faa67 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:43.273875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 461/935] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:43.291734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058086fe-5f21-45e8-9e5c-3431ff46c467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:43.292682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058086fe-5f21-45e8-9e5c-3431ff46c467 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:43.293241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058086fe-5f21-45e8-9e5c-3431ff46c467 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:43.293669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058086fe-5f21-45e8-9e5c-3431ff46c467 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:43.294576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058086fe-5f21-45e8-9e5c-3431ff46c467 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:43.296618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058086fe-5f21-45e8-9e5c-3431ff46c467 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:43.297085 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d193408-5729-46fe-8288-1550cf4540be None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:43.298396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: WARNING keystone.server.flask.common [None req-058086fe-5f21-45e8-9e5c-3431ff46c467 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 11 14:00:43.325132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.sql.core [None req-058086fe-5f21-45e8-9e5c-3431ff46c467 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:00:43.325132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 14:00:43.325132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [parameters: {'id': '23257fc6eb344aae9987c4a31e5cda9b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 14:00:43.325132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80387) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-058086fe-5f21-45e8-9e5c-3431ff46c467 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 23257fc6eb344aae9987c4a31e5cda9b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 23257fc6eb344aae9987c4a31e5cda9b. Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:00:43.337894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result.read() Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 11 14:00:43.338956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application yield resource Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise self.value Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application session.commit() Jul 11 14:00:43.340130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:00:43.341226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:00:43.342239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result.read() Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:00:43.343555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [parameters: {'id': '23257fc6eb344aae9987c4a31e5cda9b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:43.344434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:43.345601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:43.347207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:43.347207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 11 14:00:43.347207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 11 14:00:43.347207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:43.347207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:43.347207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 11 14:00:43.347207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 11 14:00:43.347207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 23257fc6eb344aae9987c4a31e5cda9b. Jul 11 14:00:43.347207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:43.351090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 475/936] 10.222.0.66 () {60 vars in 1140 bytes} [Mon Jul 11 14:00:43 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:43.355852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058086fe-5f21-45e8-9e5c-3431ff46c467 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:43.396153 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:43.419929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d193408-5729-46fe-8288-1550cf4540be None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:43.461927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f949d8-90eb-4dbd-830d-e52244b3ac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:43.463270 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f949d8-90eb-4dbd-830d-e52244b3ac0f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:43.463858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f949d8-90eb-4dbd-830d-e52244b3ac0f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:43.464338 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f949d8-90eb-4dbd-830d-e52244b3ac0f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:43.476206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f949d8-90eb-4dbd-830d-e52244b3ac0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:43.485154 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058086fe-5f21-45e8-9e5c-3431ff46c467 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-16f949d8-90eb-4dbd-830d-e52244b3ac0f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:43.485638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:43.486587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:00:43.487466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:43.490332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 462/937] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Jul 11 14:00:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:43.506669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f949d8-90eb-4dbd-830d-e52244b3ac0f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:43.518549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:43.528572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b198b82-0529-4b14-8afe-4d88e4cb12d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:43.529387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b198b82-0529-4b14-8afe-4d88e4cb12d4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:43.529735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b198b82-0529-4b14-8afe-4d88e4cb12d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:43.530024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b198b82-0529-4b14-8afe-4d88e4cb12d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:43.540875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b198b82-0529-4b14-8afe-4d88e4cb12d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:43.543565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b198b82-0529-4b14-8afe-4d88e4cb12d4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-3b198b82-0529-4b14-8afe-4d88e4cb12d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:43.563841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:43.564910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:43.565815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:43.565815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:43.565815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:43.565815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:43.565815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:43.565815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:43.565815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:43.565815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:43.570530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 476/938] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:43.572305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b198b82-0529-4b14-8afe-4d88e4cb12d4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:43.635947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f949d8-90eb-4dbd-830d-e52244b3ac0f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:43.676514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:43.684895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6167be-6e6e-44c0-a190-c074ae66fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:43.685991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6167be-6e6e-44c0-a190-c074ae66fe65 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:43.686321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6167be-6e6e-44c0-a190-c074ae66fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:43.686602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6167be-6e6e-44c0-a190-c074ae66fe65 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:43.687649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6167be-6e6e-44c0-a190-c074ae66fe65 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:43.687962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6167be-6e6e-44c0-a190-c074ae66fe65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:43.690014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6167be-6e6e-44c0-a190-c074ae66fe65 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:43.696442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b198b82-0529-4b14-8afe-4d88e4cb12d4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:43.706261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 463/939] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Jul 11 14:00:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:43.708713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6167be-6e6e-44c0-a190-c074ae66fe65 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:43.745139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee6af4-85d7-4702-9dc1-4ab5411a35d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:43.745830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee6af4-85d7-4702-9dc1-4ab5411a35d3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:43.746122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee6af4-85d7-4702-9dc1-4ab5411a35d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:43.746434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee6af4-85d7-4702-9dc1-4ab5411a35d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:43.747214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee6af4-85d7-4702-9dc1-4ab5411a35d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:43.747529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee6af4-85d7-4702-9dc1-4ab5411a35d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:43.749148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee6af4-85d7-4702-9dc1-4ab5411a35d3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:43.778284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 477/940] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:43.801124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:43.838586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6167be-6e6e-44c0-a190-c074ae66fe65 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:43.878300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecf27a-0853-409c-bafc-3a3de39d400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:43.879131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecf27a-0853-409c-bafc-3a3de39d400c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:43.879415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecf27a-0853-409c-bafc-3a3de39d400c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:43.879695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecf27a-0853-409c-bafc-3a3de39d400c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:43.892462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecf27a-0853-409c-bafc-3a3de39d400c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:43.893955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ecf27a-0853-409c-bafc-3a3de39d400c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-51ecf27a-0853-409c-bafc-3a3de39d400c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:43.913595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:43.914622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:43.915535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:43.915535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:43.915535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:43.915535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:43.915535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 464/941] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:43.922028 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee6af4-85d7-4702-9dc1-4ab5411a35d3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:44.041596 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee6af4-85d7-4702-9dc1-4ab5411a35d3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:44.077833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294dd24-718d-448f-8adc-8386ebb4f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:44.078542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294dd24-718d-448f-8adc-8386ebb4f81a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:44.078832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294dd24-718d-448f-8adc-8386ebb4f81a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:44.079113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294dd24-718d-448f-8adc-8386ebb4f81a None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:44.079854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294dd24-718d-448f-8adc-8386ebb4f81a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:44.080163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294dd24-718d-448f-8adc-8386ebb4f81a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:44.081538 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294dd24-718d-448f-8adc-8386ebb4f81a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:44.095626 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 478/942] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:44.103066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecf27a-0853-409c-bafc-3a3de39d400c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:44.210133 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecf27a-0853-409c-bafc-3a3de39d400c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:44.246598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:44.250772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29803da-af45-4b9d-9f80-e7e7cb9f9b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:44.251865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29803da-af45-4b9d-9f80-e7e7cb9f9b0e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:44.252263 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29803da-af45-4b9d-9f80-e7e7cb9f9b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:44.252625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29803da-af45-4b9d-9f80-e7e7cb9f9b0e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:44.260865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29803da-af45-4b9d-9f80-e7e7cb9f9b0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:44.262391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29803da-af45-4b9d-9f80-e7e7cb9f9b0e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e29803da-af45-4b9d-9f80-e7e7cb9f9b0e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:44.278625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:44.279631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:44.280585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:44.280585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:44.280585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:44.280585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:44.280585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:44.280585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:44.280585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:44.280585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:44.280585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:44.280585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:44.280585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 465/943] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 11 14:00:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:44.288111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294dd24-718d-448f-8adc-8386ebb4f81a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:44.299297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:44.381360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c4ca4-1231-4e3e-9665-5b6261f696be None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:44.381696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c4ca4-1231-4e3e-9665-5b6261f696be None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:44.381930 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c4ca4-1231-4e3e-9665-5b6261f696be None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:44.383485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 466/944] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:44.388918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04779cb5-7c01-459a-b53f-c7f055674fe6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:44.389209 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04779cb5-7c01-459a-b53f-c7f055674fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:44.389487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04779cb5-7c01-459a-b53f-c7f055674fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:44.409485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-04779cb5-7c01-459a-b53f-c7f055674fe6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:44.410361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294dd24-718d-448f-8adc-8386ebb4f81a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:44.411308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-04779cb5-7c01-459a-b53f-c7f055674fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:44.447339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57164f-de33-43ae-a732-641fe0785fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:44.448204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57164f-de33-43ae-a732-641fe0785fcf None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:44.448499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57164f-de33-43ae-a732-641fe0785fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:44.448783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57164f-de33-43ae-a732-641fe0785fcf None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:44.449654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57164f-de33-43ae-a732-641fe0785fcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:44.449973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57164f-de33-43ae-a732-641fe0785fcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:44.451471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57164f-de33-43ae-a732-641fe0785fcf None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:44.474512 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 479/945] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Jul 11 14:00:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:44.477384 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298066d-da45-4499-a814-f841ffad42f6 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:44.477689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298066d-da45-4499-a814-f841ffad42f6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:44.477982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298066d-da45-4499-a814-f841ffad42f6 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:44.479503 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 480/946] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:44.480070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298066d-da45-4499-a814-f841ffad42f6 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:44.490812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 467/947] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:44.492463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748fa71-4b06-4654-8387-10fa7ce7ad22 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:44.492989 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748fa71-4b06-4654-8387-10fa7ce7ad22 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:44.493332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748fa71-4b06-4654-8387-10fa7ce7ad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:44.510795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-2748fa71-4b06-4654-8387-10fa7ce7ad22 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:44.512048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2748fa71-4b06-4654-8387-10fa7ce7ad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:44.558354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:44.602693 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 468/948] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:44.603258 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298066d-da45-4499-a814-f841ffad42f6 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:44.604438 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748fa71-4b06-4654-8387-10fa7ce7ad22 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:44.643760 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782978d-1712-42df-9cb0-51d46ef36637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:44.644619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782978d-1712-42df-9cb0-51d46ef36637 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:44.644909 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782978d-1712-42df-9cb0-51d46ef36637 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:44.645440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782978d-1712-42df-9cb0-51d46ef36637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:44.656138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:44.656976 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782978d-1712-42df-9cb0-51d46ef36637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:44.658424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c782978d-1712-42df-9cb0-51d46ef36637 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-c782978d-1712-42df-9cb0-51d46ef36637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:44.678487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:44.679584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:44.680480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:44.680480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:44.680480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:44.680480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:44.684544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 481/949] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:44.685294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782978d-1712-42df-9cb0-51d46ef36637 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:44.723642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748fa71-4b06-4654-8387-10fa7ce7ad22 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:44.763197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1cecf-2c6c-466f-bcdd-ebd47b64fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:44.764077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1cecf-2c6c-466f-bcdd-ebd47b64fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:44.764437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1cecf-2c6c-466f-bcdd-ebd47b64fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:44.764793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1cecf-2c6c-466f-bcdd-ebd47b64fcc6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:44.765538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1cecf-2c6c-466f-bcdd-ebd47b64fcc6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:44.766933 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1cecf-2c6c-466f-bcdd-ebd47b64fcc6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8ac1cecf-2c6c-466f-bcdd-ebd47b64fcc6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:44.780272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:44.781426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:44.782717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 469/950] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 11 14:00:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:44.783537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1cecf-2c6c-466f-bcdd-ebd47b64fcc6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:44.797755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782978d-1712-42df-9cb0-51d46ef36637 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:44.816674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:44.841858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686d9a6-8f2b-4964-8df1-f3929184f1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:44.843493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686d9a6-8f2b-4964-8df1-f3929184f1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:44.843995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686d9a6-8f2b-4964-8df1-f3929184f1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:44.844713 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686d9a6-8f2b-4964-8df1-f3929184f1e5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:44.845883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686d9a6-8f2b-4964-8df1-f3929184f1e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:44.848062 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686d9a6-8f2b-4964-8df1-f3929184f1e5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-9686d9a6-8f2b-4964-8df1-f3929184f1e5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:44.863491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:44.864535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:00:44.865445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:44.866219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 482/951] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:44.866304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686d9a6-8f2b-4964-8df1-f3929184f1e5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:44.906134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1cecf-2c6c-466f-bcdd-ebd47b64fcc6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:44.914208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:44.947702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432a53-ebda-4ddf-a2ba-eccd929991e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:44.949162 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432a53-ebda-4ddf-a2ba-eccd929991e8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:44.949447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432a53-ebda-4ddf-a2ba-eccd929991e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:44.949726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea432a53-ebda-4ddf-a2ba-eccd929991e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:44.950491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea432a53-ebda-4ddf-a2ba-eccd929991e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:44.950798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea432a53-ebda-4ddf-a2ba-eccd929991e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:44.952194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea432a53-ebda-4ddf-a2ba-eccd929991e8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:44.971889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 470/952] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:44.971889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432a53-ebda-4ddf-a2ba-eccd929991e8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:44.980524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686d9a6-8f2b-4964-8df1-f3929184f1e5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:45.017053 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d70fba-e76c-49c8-bae4-6891112ba333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:45.017833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70fba-e76c-49c8-bae4-6891112ba333 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:45.018128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70fba-e76c-49c8-bae4-6891112ba333 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:45.018435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70fba-e76c-49c8-bae4-6891112ba333 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:45.019635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d70fba-e76c-49c8-bae4-6891112ba333 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:45.019946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d70fba-e76c-49c8-bae4-6891112ba333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:45.021572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d70fba-e76c-49c8-bae4-6891112ba333 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:45.028835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 483/953] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Jul 11 14:00:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:45.029467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d70fba-e76c-49c8-bae4-6891112ba333 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:45.081054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:45.101359 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea432a53-ebda-4ddf-a2ba-eccd929991e8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:45.139213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1c8f5-f070-4586-87d8-a2c975e705f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:45.140049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d70fba-e76c-49c8-bae4-6891112ba333 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:45.141037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1c8f5-f070-4586-87d8-a2c975e705f3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:45.141632 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1c8f5-f070-4586-87d8-a2c975e705f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:45.142271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1c8f5-f070-4586-87d8-a2c975e705f3 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:45.143093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1c8f5-f070-4586-87d8-a2c975e705f3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:45.143410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1c8f5-f070-4586-87d8-a2c975e705f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:45.144794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1c8f5-f070-4586-87d8-a2c975e705f3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:45.155525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 471/954] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:45.155525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1c8f5-f070-4586-87d8-a2c975e705f3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:45.180404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b2b2f-9148-4ea6-a7cb-6c34f01c3195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:45.181210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b2b2f-9148-4ea6-a7cb-6c34f01c3195 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:45.182052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b2b2f-9148-4ea6-a7cb-6c34f01c3195 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:45.182052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b2b2f-9148-4ea6-a7cb-6c34f01c3195 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:45.188916 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:45.189157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b2b2f-9148-4ea6-a7cb-6c34f01c3195 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:45.190674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b2b2f-9148-4ea6-a7cb-6c34f01c3195 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-9d1b2b2f-9148-4ea6-a7cb-6c34f01c3195 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:45.211802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:45.212853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:45.214500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:45.214500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:45.214500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:45.214500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:45.214500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:45.214500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:45.214500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:45.214500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:45.217891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 484/955] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:45.218866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b2b2f-9148-4ea6-a7cb-6c34f01c3195 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:45.287016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1c8f5-f070-4586-87d8-a2c975e705f3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:45.330230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51039ee0-21fc-4d78-88a5-3fb5ca9567bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:45.330858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51039ee0-21fc-4d78-88a5-3fb5ca9567bd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:45.331216 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51039ee0-21fc-4d78-88a5-3fb5ca9567bd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:45.331423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51039ee0-21fc-4d78-88a5-3fb5ca9567bd None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:45.332136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51039ee0-21fc-4d78-88a5-3fb5ca9567bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:45.332441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51039ee0-21fc-4d78-88a5-3fb5ca9567bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:45.333823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51039ee0-21fc-4d78-88a5-3fb5ca9567bd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:45.338905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b2b2f-9148-4ea6-a7cb-6c34f01c3195 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:45.339907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 472/956] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Jul 11 14:00:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:45.340748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51039ee0-21fc-4d78-88a5-3fb5ca9567bd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:45.346568 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:45.386777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3ec4d-9a57-4ca5-b05d-5337b04f42dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:45.387867 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3ec4d-9a57-4ca5-b05d-5337b04f42dc None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:45.388174 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3ec4d-9a57-4ca5-b05d-5337b04f42dc None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:45.388461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3ec4d-9a57-4ca5-b05d-5337b04f42dc None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:45.389215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3ec4d-9a57-4ca5-b05d-5337b04f42dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:45.389896 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3ec4d-9a57-4ca5-b05d-5337b04f42dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:45.391645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3ec4d-9a57-4ca5-b05d-5337b04f42dc None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:45.406204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 485/957] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:45.406204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3ec4d-9a57-4ca5-b05d-5337b04f42dc None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:45.465742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:45.474080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51039ee0-21fc-4d78-88a5-3fb5ca9567bd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:45.530904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597ab50-71ec-4e7a-9f55-238940c25fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:45.532000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ab50-71ec-4e7a-9f55-238940c25fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:45.532799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ab50-71ec-4e7a-9f55-238940c25fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:45.533088 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ab50-71ec-4e7a-9f55-238940c25fd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:45.533945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597ab50-71ec-4e7a-9f55-238940c25fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:45.534288 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597ab50-71ec-4e7a-9f55-238940c25fd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:45.535840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597ab50-71ec-4e7a-9f55-238940c25fd3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:45.552628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3ec4d-9a57-4ca5-b05d-5337b04f42dc None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:45.557840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 473/958] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:45.564864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597ab50-71ec-4e7a-9f55-238940c25fd3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:45.611996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1e7c4-c9aa-4b98-8de5-2d15844e38df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:45.612641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1e7c4-c9aa-4b98-8de5-2d15844e38df None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:45.612929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1e7c4-c9aa-4b98-8de5-2d15844e38df None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:45.613213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1e7c4-c9aa-4b98-8de5-2d15844e38df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:45.620438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1e7c4-c9aa-4b98-8de5-2d15844e38df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:45.620438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1e7c4-c9aa-4b98-8de5-2d15844e38df None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:45.655579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 486/959] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 11 14:00:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:45.728884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597ab50-71ec-4e7a-9f55-238940c25fd3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:45.779335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb43f91-5af6-4aa8-bb68-a67f1fd77867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:45.780309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb43f91-5af6-4aa8-bb68-a67f1fd77867 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:45.780597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb43f91-5af6-4aa8-bb68-a67f1fd77867 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:45.780870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb43f91-5af6-4aa8-bb68-a67f1fd77867 None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/d1dd32e8fdec4ea989cc2e83f18944f4/roles/b4157aafaef74a9fbbe56bae19de8b02` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:45.783293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb43f91-5af6-4aa8-bb68-a67f1fd77867 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=d1dd32e8fdec4ea989cc2e83f18944f4, role_id=b4157aafaef74a9fbbe56bae19de8b02)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:45.784839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb43f91-5af6-4aa8-bb68-a67f1fd77867 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:45.805179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 474/960] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:00:45 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/d1dd32e8fdec4ea989cc2e83f18944f4/roles/b4157aafaef74a9fbbe56bae19de8b02 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:00:46.017605 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fef1b-2661-4376-bf04-e039a95b3b7b None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:46.017999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fef1b-2661-4376-bf04-e039a95b3b7b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:46.018346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fef1b-2661-4376-bf04-e039a95b3b7b None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:46.020746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 487/961] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:46.026698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2b759-e81f-4b61-b453-d476b6246356 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:46.027274 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2b759-e81f-4b61-b453-d476b6246356 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:46.027768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2b759-e81f-4b61-b453-d476b6246356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:46.045222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c6e2b759-e81f-4b61-b453-d476b6246356 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:46.046808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c6e2b759-e81f-4b61-b453-d476b6246356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:46.050119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:46.123472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 475/962] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:46.148576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fef1b-2661-4376-bf04-e039a95b3b7b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:46.182975 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:46.278603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fef1b-2661-4376-bf04-e039a95b3b7b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:46.315498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9b0fe-2c6f-4b7d-8a99-c0fb6f2fd56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:46.316183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9b0fe-2c6f-4b7d-8a99-c0fb6f2fd56b None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:46.316467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9b0fe-2c6f-4b7d-8a99-c0fb6f2fd56b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:46.316745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9b0fe-2c6f-4b7d-8a99-c0fb6f2fd56b None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:46.317456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9b0fe-2c6f-4b7d-8a99-c0fb6f2fd56b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:46.319207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9b0fe-2c6f-4b7d-8a99-c0fb6f2fd56b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:46.332710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.sql.core [None req-01a9b0fe-2c6f-4b7d-8a99-c0fb6f2fd56b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:00:46.332710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 14:00:46.332710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [parameters: {'user_id': '23c6c54399eb4055ad4a045d25571197', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 14:00:46.332710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80387) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-01a9b0fe-2c6f-4b7d-8a99-c0fb6f2fd56b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result.read() Jul 11 14:00:46.341926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:00:46.343359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application yield resource Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application next(self.gen) Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.session.rollback() Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.force_reraise() Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise self.value Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application session.commit() Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 11 14:00:46.344352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._prepare_impl() Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.session.flush() Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._flush(objects) Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application compat.raise_( Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application flush_context.execute() Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rec.execute(self) Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 11 14:00:46.345273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 11 14:00:46.346197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result = self._query(query) Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application conn.query(q) Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application result.read() Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 11 14:00:46.347071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [parameters: {'user_id': '23c6c54399eb4055ad4a045d25571197', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:46.347908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 11 14:00:46.348752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 11 14:00:46.355738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 11 14:00:46.355738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 11 14:00:46.355738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 11 14:00:46.355738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 11 14:00:46.355738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 11 14:00:46.355738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:46.355738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 488/963] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Jul 11 14:00:46 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:46.358628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2b759-e81f-4b61-b453-d476b6246356 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:46.466856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2b759-e81f-4b61-b453-d476b6246356 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:46.506888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd7d85-639f-441a-b6af-e0814c971717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:46.508001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd7d85-639f-441a-b6af-e0814c971717 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:46.508284 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd7d85-639f-441a-b6af-e0814c971717 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:46.508561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd7d85-639f-441a-b6af-e0814c971717 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:46.516523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd7d85-639f-441a-b6af-e0814c971717 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:46.517984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd7d85-639f-441a-b6af-e0814c971717 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:46.520961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7afd7d85-639f-441a-b6af-e0814c971717 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:46.535762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:46.536927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:46.538835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:46.538835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:46.538835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:46.538835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:46.538835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:46.538835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:46.538835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:46.538835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:46.538835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 11 14:00:46.538835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:46.541495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 476/964] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:46.552139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9b0fe-2c6f-4b7d-8a99-c0fb6f2fd56b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:46.682706 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:46.688592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9b0fe-2c6f-4b7d-8a99-c0fb6f2fd56b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:46.734707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75827ad-1f43-48fb-9c88-6d341b2ad1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:46.735509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75827ad-1f43-48fb-9c88-6d341b2ad1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:46.735796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75827ad-1f43-48fb-9c88-6d341b2ad1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:46.736072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75827ad-1f43-48fb-9c88-6d341b2ad1f7 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:46.736925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75827ad-1f43-48fb-9c88-6d341b2ad1f7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:46.737234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75827ad-1f43-48fb-9c88-6d341b2ad1f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:46.738941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75827ad-1f43-48fb-9c88-6d341b2ad1f7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:46.783107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 489/965] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Jul 11 14:00:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:47.586131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd171a2-9415-4f46-b3d8-58878442b7bc None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:47.586653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd171a2-9415-4f46-b3d8-58878442b7bc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:47.586653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd171a2-9415-4f46-b3d8-58878442b7bc None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:47.588047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 477/966] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:47.593310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165e9c4-cd94-4466-8af6-5304a922a284 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:47.593733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165e9c4-cd94-4466-8af6-5304a922a284 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:47.593917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165e9c4-cd94-4466-8af6-5304a922a284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:47.611769 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-6165e9c4-cd94-4466-8af6-5304a922a284 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:47.613301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6165e9c4-cd94-4466-8af6-5304a922a284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:47.689741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 490/967] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:47.713455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd171a2-9415-4f46-b3d8-58878442b7bc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:47.830127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd171a2-9415-4f46-b3d8-58878442b7bc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:47.865373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b294829-1549-4545-92f0-01300e81d230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:47.866305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294829-1549-4545-92f0-01300e81d230 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:47.866593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294829-1549-4545-92f0-01300e81d230 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:47.866873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b294829-1549-4545-92f0-01300e81d230 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:47.867606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b294829-1549-4545-92f0-01300e81d230 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:47.868983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b294829-1549-4545-92f0-01300e81d230 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:47.885432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 478/968] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 14:00:47 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:47.893552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67643c-c627-4ec2-bda1-f761d5267791 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:47.893897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67643c-c627-4ec2-bda1-f761d5267791 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:47.894126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67643c-c627-4ec2-bda1-f761d5267791 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:47.896029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 491/969] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:47.902546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a510df-7583-4c13-9750-61147bb9e492 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:47.902929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a510df-7583-4c13-9750-61147bb9e492 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:47.903116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a510df-7583-4c13-9750-61147bb9e492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:47.907336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37e9f4-1738-4247-beb1-e09d4b1046f8 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:47.907646 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37e9f4-1738-4247-beb1-e09d4b1046f8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:47.907909 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37e9f4-1738-4247-beb1-e09d4b1046f8 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:47.911087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 492/970] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:47.917623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582992c-e8c9-4575-a6ca-5ebafeecd183 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:47.917956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582992c-e8c9-4575-a6ca-5ebafeecd183 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:47.918524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582992c-e8c9-4575-a6ca-5ebafeecd183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:47.922265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-09a510df-7583-4c13-9750-61147bb9e492 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:47.923502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-09a510df-7583-4c13-9750-61147bb9e492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:47.939711 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f582992c-e8c9-4575-a6ca-5ebafeecd183 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:47.940935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f582992c-e8c9-4575-a6ca-5ebafeecd183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:47.996234 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:48.031314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 479/971] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:48.042768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 493/972] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:48.054884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a510df-7583-4c13-9750-61147bb9e492 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:48.067049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582992c-e8c9-4575-a6ca-5ebafeecd183 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:48.071074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:48.167948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a510df-7583-4c13-9750-61147bb9e492 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:48.190396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582992c-e8c9-4575-a6ca-5ebafeecd183 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:48.208539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e066e8-67a5-4f66-b6f5-3eb4424fc343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:48.209564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e066e8-67a5-4f66-b6f5-3eb4424fc343 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:48.209849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e066e8-67a5-4f66-b6f5-3eb4424fc343 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:48.210251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e066e8-67a5-4f66-b6f5-3eb4424fc343 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:48.210921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e066e8-67a5-4f66-b6f5-3eb4424fc343 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:48.212300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e066e8-67a5-4f66-b6f5-3eb4424fc343 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-22e066e8-67a5-4f66-b6f5-3eb4424fc343 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:48.224918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:48.226009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:48.226960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 480/973] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 11 14:00:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:48.232166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e066e8-67a5-4f66-b6f5-3eb4424fc343 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:48.237191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f122f-6f9d-4113-b6c9-f9b6d958bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:48.238091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f122f-6f9d-4113-b6c9-f9b6d958bb3f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:48.238476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f122f-6f9d-4113-b6c9-f9b6d958bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:48.238828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f122f-6f9d-4113-b6c9-f9b6d958bb3f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:48.250801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f122f-6f9d-4113-b6c9-f9b6d958bb3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-045f122f-6f9d-4113-b6c9-f9b6d958bb3f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:48.259983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:48.260984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:00:48.261820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:48.266275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 494/974] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Jul 11 14:00:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:48.267123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f122f-6f9d-4113-b6c9-f9b6d958bb3f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:48.292069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:48.333222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:48.358410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e066e8-67a5-4f66-b6f5-3eb4424fc343 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:48.376648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f122f-6f9d-4113-b6c9-f9b6d958bb3f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:48.402085 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e119d-8e27-42d8-a5a5-6a20a1e9bb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:48.403325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e119d-8e27-42d8-a5a5-6a20a1e9bb4b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:48.403325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e119d-8e27-42d8-a5a5-6a20a1e9bb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:48.403325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e119d-8e27-42d8-a5a5-6a20a1e9bb4b None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:48.404031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e119d-8e27-42d8-a5a5-6a20a1e9bb4b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:48.404334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e119d-8e27-42d8-a5a5-6a20a1e9bb4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:48.405718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e119d-8e27-42d8-a5a5-6a20a1e9bb4b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:48.414772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 481/975] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Jul 11 14:00:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:48.420307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e119d-8e27-42d8-a5a5-6a20a1e9bb4b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:48.423729 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e473748-a4f8-4528-ac04-9e285395678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:48.424501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e473748-a4f8-4528-ac04-9e285395678d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:48.424708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e473748-a4f8-4528-ac04-9e285395678d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:48.424980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e473748-a4f8-4528-ac04-9e285395678d None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:48.425934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e473748-a4f8-4528-ac04-9e285395678d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:48.426272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e473748-a4f8-4528-ac04-9e285395678d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:48.428206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e473748-a4f8-4528-ac04-9e285395678d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:48.442555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 495/976] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Jul 11 14:00:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:48.444279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e473748-a4f8-4528-ac04-9e285395678d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:48.548191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e119d-8e27-42d8-a5a5-6a20a1e9bb4b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:48.548811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e473748-a4f8-4528-ac04-9e285395678d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:48.563345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:48.580919 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:48.590202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787d143-61e7-4fbe-962c-4cb187b87acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:48.591367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bccf96-7e9c-40d0-8f5e-847ff2c179ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:48.591569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787d143-61e7-4fbe-962c-4cb187b87acf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:48.592011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787d143-61e7-4fbe-962c-4cb187b87acf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:48.592164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bccf96-7e9c-40d0-8f5e-847ff2c179ea None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:48.592454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bccf96-7e9c-40d0-8f5e-847ff2c179ea None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:48.592702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787d143-61e7-4fbe-962c-4cb187b87acf None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:48.592811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bccf96-7e9c-40d0-8f5e-847ff2c179ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:48.593633 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787d143-61e7-4fbe-962c-4cb187b87acf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:48.594094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787d143-61e7-4fbe-962c-4cb187b87acf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:48.595630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787d143-61e7-4fbe-962c-4cb187b87acf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:48.601901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 482/977] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Jul 11 14:00:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:48.605670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bccf96-7e9c-40d0-8f5e-847ff2c179ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:48.607240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bccf96-7e9c-40d0-8f5e-847ff2c179ea None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:48.607740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787d143-61e7-4fbe-962c-4cb187b87acf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-93bccf96-7e9c-40d0-8f5e-847ff2c179ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:48.625891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:48.626890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:48.627816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:48.627816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:48.627816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:48.627816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:48.627816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 496/978] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:48.632718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bccf96-7e9c-40d0-8f5e-847ff2c179ea None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:48.719353 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787d143-61e7-4fbe-962c-4cb187b87acf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:48.744099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bccf96-7e9c-40d0-8f5e-847ff2c179ea None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:48.756060 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008fe4f-c6ea-4d45-816d-a02b5e0538b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:48.756917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008fe4f-c6ea-4d45-816d-a02b5e0538b4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:48.757203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008fe4f-c6ea-4d45-816d-a02b5e0538b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:48.757481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008fe4f-c6ea-4d45-816d-a02b5e0538b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:48.758340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008fe4f-c6ea-4d45-816d-a02b5e0538b4 None admin] RBAC: Adding query filter params (interface=admin, service_id=03cc1af025f2472f834a44ca5f518305, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:48.758658 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008fe4f-c6ea-4d45-816d-a02b5e0538b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:48.760055 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008fe4f-c6ea-4d45-816d-a02b5e0538b4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:48.766389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 483/979] 10.222.0.66 () {56 vars in 1249 bytes} [Mon Jul 11 14:00:48 2022] GET /identity/v3/endpoints?service_id=03cc1af025f2472f834a44ca5f518305&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:48.773001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008fe4f-c6ea-4d45-816d-a02b5e0538b4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:48.784306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d52293-2848-41ff-932d-a2c5ac4d3746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:48.784995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d52293-2848-41ff-932d-a2c5ac4d3746 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:48.785284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d52293-2848-41ff-932d-a2c5ac4d3746 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:48.785890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d52293-2848-41ff-932d-a2c5ac4d3746 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:48.786671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d52293-2848-41ff-932d-a2c5ac4d3746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:48.786988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d52293-2848-41ff-932d-a2c5ac4d3746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:48.789016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d52293-2848-41ff-932d-a2c5ac4d3746 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:48.802490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 497/980] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:48.808297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d52293-2848-41ff-932d-a2c5ac4d3746 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:48.824906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:48.851447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:48.888009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008fe4f-c6ea-4d45-816d-a02b5e0538b4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:48.920428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d52293-2848-41ff-932d-a2c5ac4d3746 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:48.923566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb09c-aa3b-465a-b195-216b608972ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:48.924243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb09c-aa3b-465a-b195-216b608972ec None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:48.924531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb09c-aa3b-465a-b195-216b608972ec None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:48.924814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fb09c-aa3b-465a-b195-216b608972ec None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:48.925501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fb09c-aa3b-465a-b195-216b608972ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:48.926903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fb09c-aa3b-465a-b195-216b608972ec None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:48.942206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 484/981] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 11 14:00:48 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:00:48.968625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8642306-07e9-48be-a1ac-d2934e6b0c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:48.969557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8642306-07e9-48be-a1ac-d2934e6b0c72 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:48.969783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8642306-07e9-48be-a1ac-d2934e6b0c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:48.970063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8642306-07e9-48be-a1ac-d2934e6b0c72 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:48.978847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8642306-07e9-48be-a1ac-d2934e6b0c72 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:48.980324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8642306-07e9-48be-a1ac-d2934e6b0c72 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-d8642306-07e9-48be-a1ac-d2934e6b0c72 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:48.998339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:48.999472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:49.000478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:49.000478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:49.000478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:49.000478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:49.000478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:49.000478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:49.000478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:49.000478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:49.000478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 11 14:00:49.000478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:49.000478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 498/982] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 11 14:00:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:49.005611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb09c-aa3b-465a-b195-216b608972ec None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:49.119917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fb09c-aa3b-465a-b195-216b608972ec None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:49.127773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:49.157985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2413cf-804a-4f37-ba4f-2fb39055540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:49.158817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2413cf-804a-4f37-ba4f-2fb39055540a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:49.159108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2413cf-804a-4f37-ba4f-2fb39055540a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:49.159388 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2413cf-804a-4f37-ba4f-2fb39055540a None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:49.160236 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2413cf-804a-4f37-ba4f-2fb39055540a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:49.160556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2413cf-804a-4f37-ba4f-2fb39055540a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:49.161997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2413cf-804a-4f37-ba4f-2fb39055540a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:49.185154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 485/983] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Jul 11 14:00:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:49.186507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8642306-07e9-48be-a1ac-d2934e6b0c72 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:49.293256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:49.297654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8642306-07e9-48be-a1ac-d2934e6b0c72 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:49.335860 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb529a38-05d4-48d0-a2a1-73f5f33fed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:49.336521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb529a38-05d4-48d0-a2a1-73f5f33fed97 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:49.336806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb529a38-05d4-48d0-a2a1-73f5f33fed97 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:49.337085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb529a38-05d4-48d0-a2a1-73f5f33fed97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:49.405495 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb529a38-05d4-48d0-a2a1-73f5f33fed97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:49.407476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb529a38-05d4-48d0-a2a1-73f5f33fed97 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:49.507246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:49.513036 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 499/984] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:49 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:00:49.518607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2413cf-804a-4f37-ba4f-2fb39055540a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:49.624313 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2413cf-804a-4f37-ba4f-2fb39055540a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:49.659581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a6a92-56c3-4e47-970c-cc42658163aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:49.660375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a6a92-56c3-4e47-970c-cc42658163aa None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:49.660663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a6a92-56c3-4e47-970c-cc42658163aa None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:49.660940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926a6a92-56c3-4e47-970c-cc42658163aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:49.672351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a6a92-56c3-4e47-970c-cc42658163aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:49.673824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926a6a92-56c3-4e47-970c-cc42658163aa None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-926a6a92-56c3-4e47-970c-cc42658163aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:49.691758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:49.692717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:49.693702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:49.693702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:49.693702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:49.693702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:49.693702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 486/985] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:49.699916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb529a38-05d4-48d0-a2a1-73f5f33fed97 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:49.803326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb529a38-05d4-48d0-a2a1-73f5f33fed97 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:49.840832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8b488-dd24-4cff-9314-c206f202ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:49.841509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b488-dd24-4cff-9314-c206f202ede9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:49.841799 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b488-dd24-4cff-9314-c206f202ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:49.842080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b488-dd24-4cff-9314-c206f202ede9 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:49.842839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8b488-dd24-4cff-9314-c206f202ede9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:49.843157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8b488-dd24-4cff-9314-c206f202ede9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:49.844540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8b488-dd24-4cff-9314-c206f202ede9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:49.861386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 500/986] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:49.862789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a6a92-56c3-4e47-970c-cc42658163aa None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:49.882339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:49.969700 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926a6a92-56c3-4e47-970c-cc42658163aa None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:49.996981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2b09d-1dd7-42ce-921e-7b4f2b775365 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:49.997273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2b09d-1dd7-42ce-921e-7b4f2b775365 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:49.997563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2b09d-1dd7-42ce-921e-7b4f2b775365 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:49.998985 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 501/987] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:50.003904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762773d-bd3d-4af8-be2a-dbace92e3365 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:50.004199 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762773d-bd3d-4af8-be2a-dbace92e3365 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:50.004487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762773d-bd3d-4af8-be2a-dbace92e3365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:50.006360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd0850-eebc-46e6-8b01-a6363bb694f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:50.007623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd0850-eebc-46e6-8b01-a6363bb694f5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:50.007905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd0850-eebc-46e6-8b01-a6363bb694f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:50.008181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd0850-eebc-46e6-8b01-a6363bb694f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:50.015671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd0850-eebc-46e6-8b01-a6363bb694f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:50.017157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd0850-eebc-46e6-8b01-a6363bb694f5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:50.025779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-6762773d-bd3d-4af8-be2a-dbace92e3365 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:50.027426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6762773d-bd3d-4af8-be2a-dbace92e3365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-04bd0850-eebc-46e6-8b01-a6363bb694f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:50.034956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:50.035936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:50.036832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:50.036832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:50.036832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:50.036832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:50.036832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:50.036832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:50.036832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:50.036832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:50.036832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 487/988] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:50.042743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd0850-eebc-46e6-8b01-a6363bb694f5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:50.091939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:50.110322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 502/989] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:50.127417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:50.132805 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762773d-bd3d-4af8-be2a-dbace92e3365 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:50.153428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd0850-eebc-46e6-8b01-a6363bb694f5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:50.190261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784a31d-b3ef-4d7a-9f92-1cb46feb2285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:50.191286 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a31d-b3ef-4d7a-9f92-1cb46feb2285 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:50.191815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a31d-b3ef-4d7a-9f92-1cb46feb2285 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:50.192192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784a31d-b3ef-4d7a-9f92-1cb46feb2285 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:50.192991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784a31d-b3ef-4d7a-9f92-1cb46feb2285 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:50.193374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784a31d-b3ef-4d7a-9f92-1cb46feb2285 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:50.194904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2784a31d-b3ef-4d7a-9f92-1cb46feb2285 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:50.212237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 488/990] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:50.217331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784a31d-b3ef-4d7a-9f92-1cb46feb2285 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:50.251295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762773d-bd3d-4af8-be2a-dbace92e3365 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:50.286547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72ede7-cdbb-4958-86fb-ab6118553526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:50.287880 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72ede7-cdbb-4958-86fb-ab6118553526 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:50.288170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72ede7-cdbb-4958-86fb-ab6118553526 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:50.288444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72ede7-cdbb-4958-86fb-ab6118553526 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:50.289103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72ede7-cdbb-4958-86fb-ab6118553526 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:50.290495 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72ede7-cdbb-4958-86fb-ab6118553526 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-3c72ede7-cdbb-4958-86fb-ab6118553526 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:50.302323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:50.304241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:50.305305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 503/991] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:50.310312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72ede7-cdbb-4958-86fb-ab6118553526 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:50.331036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784a31d-b3ef-4d7a-9f92-1cb46feb2285 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:50.367759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:50.370186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c8891-5936-42a4-943f-006f0fe7ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:50.371092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8891-5936-42a4-943f-006f0fe7ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:50.371689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8891-5936-42a4-943f-006f0fe7ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:50.371969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c8891-5936-42a4-943f-006f0fe7ccb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:50.373139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c8891-5936-42a4-943f-006f0fe7ccb0 None admin] RBAC: Adding query filter params (role.id=b4157aafaef74a9fbbe56bae19de8b02, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=d1dd32e8fdec4ea989cc2e83f18944f4) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:50.373290 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c8891-5936-42a4-943f-006f0fe7ccb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:50.374859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c8891-5936-42a4-943f-006f0fe7ccb0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:50.377950 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:50.394644 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 489/992] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:50 2022] GET /identity/v3/role_assignments?user.id=d1dd32e8fdec4ea989cc2e83f18944f4&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=b4157aafaef74a9fbbe56bae19de8b02 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:50.435592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72ede7-cdbb-4958-86fb-ab6118553526 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:50.475371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ec25e-59a6-46a0-ab52-a234053166aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:50.476338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ec25e-59a6-46a0-ab52-a234053166aa None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:50.476778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ec25e-59a6-46a0-ab52-a234053166aa None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:50.477248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ec25e-59a6-46a0-ab52-a234053166aa None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:50.478228 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ec25e-59a6-46a0-ab52-a234053166aa None admin] RBAC: Adding query filter params (name=compute) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:50.478691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ec25e-59a6-46a0-ab52-a234053166aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:50.480251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ec25e-59a6-46a0-ab52-a234053166aa None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:50.486521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 504/993] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:50.494316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c8891-5936-42a4-943f-006f0fe7ccb0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:50.609280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c8891-5936-42a4-943f-006f0fe7ccb0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:50.645478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61033-c7d6-439d-911b-8e7ec0e094b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:50.646105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61033-c7d6-439d-911b-8e7ec0e094b2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:50.646411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61033-c7d6-439d-911b-8e7ec0e094b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:50.646745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c61033-c7d6-439d-911b-8e7ec0e094b2 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:50.647555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c61033-c7d6-439d-911b-8e7ec0e094b2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:50.647864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c61033-c7d6-439d-911b-8e7ec0e094b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:50.649241 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c61033-c7d6-439d-911b-8e7ec0e094b2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:50.658910 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 490/994] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:50.660416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ec25e-59a6-46a0-ab52-a234053166aa None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:50.764702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ec25e-59a6-46a0-ab52-a234053166aa None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:50.781439 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:50.801529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1870e-43f7-490d-9cdc-adb1ee25c1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:50.802280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1870e-43f7-490d-9cdc-adb1ee25c1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:50.802648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1870e-43f7-490d-9cdc-adb1ee25c1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:50.803473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1870e-43f7-490d-9cdc-adb1ee25c1c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:50.804304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1870e-43f7-490d-9cdc-adb1ee25c1c1 None admin] RBAC: Adding query filter params (interface=public, service_id=94c866012094433080e200c8c064a22f, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:50.804616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1870e-43f7-490d-9cdc-adb1ee25c1c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:50.806004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1870e-43f7-490d-9cdc-adb1ee25c1c1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:50.815965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 505/995] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 11 14:00:50 2022] GET /identity/v3/endpoints?service_id=94c866012094433080e200c8c064a22f&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:50.817271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61033-c7d6-439d-911b-8e7ec0e094b2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:50.890009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:50.931427 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c61033-c7d6-439d-911b-8e7ec0e094b2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:50.967369 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2a828-b070-4110-bbdd-3e0c1a1a2fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:50.968107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2a828-b070-4110-bbdd-3e0c1a1a2fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:50.968393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2a828-b070-4110-bbdd-3e0c1a1a2fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:50.968670 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2a828-b070-4110-bbdd-3e0c1a1a2fc3 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:50.969374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2a828-b070-4110-bbdd-3e0c1a1a2fc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:50.970781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2a828-b070-4110-bbdd-3e0c1a1a2fc3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:50.977771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 491/996] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 11 14:00:50 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:00:51.046452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15579eea-b50c-4027-8924-6ef05c4974d1 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:51.046755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15579eea-b50c-4027-8924-6ef05c4974d1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:51.047089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15579eea-b50c-4027-8924-6ef05c4974d1 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:51.048768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 506/997] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:51.054498 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a1dfd-ab92-435d-8203-7fe10e7ec146 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:51.054823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a1dfd-ab92-435d-8203-7fe10e7ec146 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:51.055077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a1dfd-ab92-435d-8203-7fe10e7ec146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:51.074093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-098a1dfd-ab92-435d-8203-7fe10e7ec146 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:51.075372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-098a1dfd-ab92-435d-8203-7fe10e7ec146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:51.154997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 492/998] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:51.181013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15579eea-b50c-4027-8924-6ef05c4974d1 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:51.291904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15579eea-b50c-4027-8924-6ef05c4974d1 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:51.327039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc565af-90b3-4d8e-b94b-334f95412b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:51.327836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc565af-90b3-4d8e-b94b-334f95412b17 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:51.328119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc565af-90b3-4d8e-b94b-334f95412b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:51.328392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc565af-90b3-4d8e-b94b-334f95412b17 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:51.329045 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc565af-90b3-4d8e-b94b-334f95412b17 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:51.330428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc565af-90b3-4d8e-b94b-334f95412b17 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-afc565af-90b3-4d8e-b94b-334f95412b17 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:51.342634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:51.343728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:51.344791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 507/999] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Jul 11 14:00:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:51.352036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a1dfd-ab92-435d-8203-7fe10e7ec146 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:51.413921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:51.460773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a1dfd-ab92-435d-8203-7fe10e7ec146 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:51.496080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b105-ec75-4d0c-9741-a53482e4e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:51.496678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b105-ec75-4d0c-9741-a53482e4e9af None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:51.496960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b105-ec75-4d0c-9741-a53482e4e9af None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:51.497237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25b105-ec75-4d0c-9741-a53482e4e9af None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:51.498013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25b105-ec75-4d0c-9741-a53482e4e9af None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:51.498363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25b105-ec75-4d0c-9741-a53482e4e9af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:51.499785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25b105-ec75-4d0c-9741-a53482e4e9af None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:51.504961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 493/1000] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Jul 11 14:00:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:51.511430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc565af-90b3-4d8e-b94b-334f95412b17 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:51.562268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:51.619926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc565af-90b3-4d8e-b94b-334f95412b17 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:51.653772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de6541-04c6-44e7-8340-0c7de2fc32da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:51.654479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de6541-04c6-44e7-8340-0c7de2fc32da None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:51.654772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de6541-04c6-44e7-8340-0c7de2fc32da None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:51.655053 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de6541-04c6-44e7-8340-0c7de2fc32da None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:51.655768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de6541-04c6-44e7-8340-0c7de2fc32da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:51.656081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de6541-04c6-44e7-8340-0c7de2fc32da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:51.657458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de6541-04c6-44e7-8340-0c7de2fc32da None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:51.663474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 508/1001] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Jul 11 14:00:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:51.669003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b105-ec75-4d0c-9741-a53482e4e9af None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:51.773613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25b105-ec75-4d0c-9741-a53482e4e9af None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:51.796547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:51.810449 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfa152-6ab6-4e58-b0fe-1141b9749ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:51.811144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfa152-6ab6-4e58-b0fe-1141b9749ad6 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:51.811410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfa152-6ab6-4e58-b0fe-1141b9749ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:51.811683 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfa152-6ab6-4e58-b0fe-1141b9749ad6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:51.812445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfa152-6ab6-4e58-b0fe-1141b9749ad6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:51.813823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfa152-6ab6-4e58-b0fe-1141b9749ad6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:51.840785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 494/1002] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 11 14:00:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:52.486655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b143e7b-8355-48f1-9d83-01189f5a4b05 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:52.487191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b143e7b-8355-48f1-9d83-01189f5a4b05 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:52.487191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b143e7b-8355-48f1-9d83-01189f5a4b05 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:52.488554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 509/1003] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:52.494585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74489092-25d8-4d91-9919-362018f7c0b1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:52.494878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74489092-25d8-4d91-9919-362018f7c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:52.495154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74489092-25d8-4d91-9919-362018f7c0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:52.512819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-74489092-25d8-4d91-9919-362018f7c0b1 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:52.514019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-74489092-25d8-4d91-9919-362018f7c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:52.588402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 495/1004] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:52 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:52.610652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b143e7b-8355-48f1-9d83-01189f5a4b05 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:52.716609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b143e7b-8355-48f1-9d83-01189f5a4b05 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:52.726629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:52.752245 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb068f40-d0d1-46dc-9c06-6bd97f80651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:52.752963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb068f40-d0d1-46dc-9c06-6bd97f80651e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:52.753249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb068f40-d0d1-46dc-9c06-6bd97f80651e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:52.753527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb068f40-d0d1-46dc-9c06-6bd97f80651e None admin] PATH_INFO: `/v3/services/image` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:52.754203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb068f40-d0d1-46dc-9c06-6bd97f80651e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:52.755720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb068f40-d0d1-46dc-9c06-6bd97f80651e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-eb068f40-d0d1-46dc-9c06-6bd97f80651e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:52.767309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:52.768310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:00:52.769256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:52.771130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 510/1005] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Jul 11 14:00:52 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:52.775384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74489092-25d8-4d91-9919-362018f7c0b1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:52.877661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74489092-25d8-4d91-9919-362018f7c0b1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:52.888168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:52.917974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728295d5-db7c-4787-a4fb-c57616c64a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:52.918913 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728295d5-db7c-4787-a4fb-c57616c64a48 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:52.919359 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728295d5-db7c-4787-a4fb-c57616c64a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:52.919772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728295d5-db7c-4787-a4fb-c57616c64a48 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:52.920638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728295d5-db7c-4787-a4fb-c57616c64a48 None admin] RBAC: Adding query filter params (name=image) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:52.921099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728295d5-db7c-4787-a4fb-c57616c64a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:52.922658 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728295d5-db7c-4787-a4fb-c57616c64a48 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:52.928878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 496/1006] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:52.934201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb068f40-d0d1-46dc-9c06-6bd97f80651e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:53.041943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb068f40-d0d1-46dc-9c06-6bd97f80651e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:53.054853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7971d2-7878-4717-8441-24e6f73669a5 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:53.055145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7971d2-7878-4717-8441-24e6f73669a5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:53.055414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7971d2-7878-4717-8441-24e6f73669a5 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:53.056917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 497/1007] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:00:53.061816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedf699-365b-4674-9fb6-8f2ddb1e05b6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:53.062115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedf699-365b-4674-9fb6-8f2ddb1e05b6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:53.062382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedf699-365b-4674-9fb6-8f2ddb1e05b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:53.078057 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7516b3-61b0-4ddf-9539-aab76b161932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:53.078804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7516b3-61b0-4ddf-9539-aab76b161932 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:53.079100 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7516b3-61b0-4ddf-9539-aab76b161932 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:53.079377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7516b3-61b0-4ddf-9539-aab76b161932 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:53.079577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0aedf699-365b-4674-9fb6-8f2ddb1e05b6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:53.080248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7516b3-61b0-4ddf-9539-aab76b161932 None admin] RBAC: Adding query filter params (type=image) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:53.080425 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7516b3-61b0-4ddf-9539-aab76b161932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:53.080770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0aedf699-365b-4674-9fb6-8f2ddb1e05b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:53.081757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7516b3-61b0-4ddf-9539-aab76b161932 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:53.094187 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 511/1008] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:53.170904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 498/1009] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:53.194234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7516b3-61b0-4ddf-9539-aab76b161932 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:53.244149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:53.313398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7516b3-61b0-4ddf-9539-aab76b161932 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:53.346680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbbb10-b31f-4308-853c-7e7f7b4246b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:53.347482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbbb10-b31f-4308-853c-7e7f7b4246b9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:53.347765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbbb10-b31f-4308-853c-7e7f7b4246b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:53.348042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbbb10-b31f-4308-853c-7e7f7b4246b9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:53.348697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbbb10-b31f-4308-853c-7e7f7b4246b9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:53.350689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbbb10-b31f-4308-853c-7e7f7b4246b9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-c9bbbb10-b31f-4308-853c-7e7f7b4246b9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:53.362788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:53.363858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:53.364726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 512/1010] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:53.371375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedf699-365b-4674-9fb6-8f2ddb1e05b6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:53.472256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedf699-365b-4674-9fb6-8f2ddb1e05b6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:53.473833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:53.509960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d5e7c-d25e-4c7d-ac4e-39baa7b661aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:53.510666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d5e7c-d25e-4c7d-ac4e-39baa7b661aa None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:53.510945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d5e7c-d25e-4c7d-ac4e-39baa7b661aa None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:53.511218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d5e7c-d25e-4c7d-ac4e-39baa7b661aa None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:53.511923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d5e7c-d25e-4c7d-ac4e-39baa7b661aa None admin] RBAC: Adding query filter params (name=compute) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:53.512226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d5e7c-d25e-4c7d-ac4e-39baa7b661aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:53.513597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d5e7c-d25e-4c7d-ac4e-39baa7b661aa None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:53.524156 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 499/1011] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:53.525584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbbb10-b31f-4308-853c-7e7f7b4246b9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:53.629078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:53.633125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbbb10-b31f-4308-853c-7e7f7b4246b9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:53.668727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd52f8-d899-418b-9ce6-79e1e88f3cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:53.669399 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd52f8-d899-418b-9ce6-79e1e88f3cba None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:53.669682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd52f8-d899-418b-9ce6-79e1e88f3cba None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:53.669966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd52f8-d899-418b-9ce6-79e1e88f3cba None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:53.670700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd52f8-d899-418b-9ce6-79e1e88f3cba None admin] RBAC: Adding query filter params (type=compute) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:53.671009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd52f8-d899-418b-9ce6-79e1e88f3cba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:53.672375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd52f8-d899-418b-9ce6-79e1e88f3cba None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:53.682330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 513/1012] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Jul 11 14:00:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:53.683522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d5e7c-d25e-4c7d-ac4e-39baa7b661aa None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:53.792806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d5e7c-d25e-4c7d-ac4e-39baa7b661aa None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:53.829036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ee19d-7102-46d2-bfca-145de8520976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:53.829692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee19d-7102-46d2-bfca-145de8520976 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:53.829973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee19d-7102-46d2-bfca-145de8520976 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:53.830279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee19d-7102-46d2-bfca-145de8520976 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:53.831022 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ee19d-7102-46d2-bfca-145de8520976 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:53.832388 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ee19d-7102-46d2-bfca-145de8520976 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:53.854300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 500/1013] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 11 14:00:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:53.948243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54968cc-4651-467b-b3ee-9de021220993 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:53.948613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54968cc-4651-467b-b3ee-9de021220993 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:53.948943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54968cc-4651-467b-b3ee-9de021220993 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:53.950439 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 514/1014] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:53.955874 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ad51-0b92-4744-ae93-f36ab5aea953 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:53.956174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ad51-0b92-4744-ae93-f36ab5aea953 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:53.956461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ad51-0b92-4744-ae93-f36ab5aea953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:53.974850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c2b2ad51-0b92-4744-ae93-f36ab5aea953 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:53.976106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c2b2ad51-0b92-4744-ae93-f36ab5aea953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:53.996480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:54.059743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 501/1015] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:53 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:54.086118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54968cc-4651-467b-b3ee-9de021220993 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:54.207759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54968cc-4651-467b-b3ee-9de021220993 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:54.247797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38048f81-3f25-45b5-b76e-a46093ccb052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:54.248604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38048f81-3f25-45b5-b76e-a46093ccb052 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:54.248888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38048f81-3f25-45b5-b76e-a46093ccb052 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:54.249163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38048f81-3f25-45b5-b76e-a46093ccb052 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:54.250391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38048f81-3f25-45b5-b76e-a46093ccb052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:54.251830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38048f81-3f25-45b5-b76e-a46093ccb052 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:54.258214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 515/1016] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:54.260307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ad51-0b92-4744-ae93-f36ab5aea953 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:54.363881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ad51-0b92-4744-ae93-f36ab5aea953 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:54.399249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38b5b8-01b1-4782-bec2-773d71761fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:54.399930 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38b5b8-01b1-4782-bec2-773d71761fba None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:54.400203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38b5b8-01b1-4782-bec2-773d71761fba None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:54.400480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38b5b8-01b1-4782-bec2-773d71761fba None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:54.401187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38b5b8-01b1-4782-bec2-773d71761fba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:54.402664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df38b5b8-01b1-4782-bec2-773d71761fba None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:54.422888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:54.432029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 502/1017] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 14:00:54 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:55.148157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94ff41-29fd-4828-b03c-ef82848658d1 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:55.148690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94ff41-29fd-4828-b03c-ef82848658d1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:55.148690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94ff41-29fd-4828-b03c-ef82848658d1 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:55.150250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 516/1018] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:55.155202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cf25a-f794-4ba4-b76b-02bed5a0f102 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:55.155596 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cf25a-f794-4ba4-b76b-02bed5a0f102 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:55.155755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cf25a-f794-4ba4-b76b-02bed5a0f102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:55.172531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-be8cf25a-f794-4ba4-b76b-02bed5a0f102 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:55.173728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-be8cf25a-f794-4ba4-b76b-02bed5a0f102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:55.251192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 503/1019] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:55.274898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94ff41-29fd-4828-b03c-ef82848658d1 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:55.309840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:55.383247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94ff41-29fd-4828-b03c-ef82848658d1 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:55.417074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873dcfe-e417-49af-859e-f65869dbef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:55.417671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873dcfe-e417-49af-859e-f65869dbef5c None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:55.417958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873dcfe-e417-49af-859e-f65869dbef5c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:55.418265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873dcfe-e417-49af-859e-f65869dbef5c None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:55.419056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873dcfe-e417-49af-859e-f65869dbef5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:55.420371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873dcfe-e417-49af-859e-f65869dbef5c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:55.434189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 517/1020] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 14:00:55 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:56.071235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd77ea-6f70-456c-95e8-a3a3e1bf196a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:56.071623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd77ea-6f70-456c-95e8-a3a3e1bf196a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:56.071823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd77ea-6f70-456c-95e8-a3a3e1bf196a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:56.073321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 504/1021] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:56.078858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93cd4-1ce0-4c5e-a5e6-0003d36b95f8 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:56.079224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93cd4-1ce0-4c5e-a5e6-0003d36b95f8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:56.079728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c93cd4-1ce0-4c5e-a5e6-0003d36b95f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:56.097330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b7c93cd4-1ce0-4c5e-a5e6-0003d36b95f8 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:56.098559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b7c93cd4-1ce0-4c5e-a5e6-0003d36b95f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:56.180775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 518/1022] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:56.207020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd77ea-6f70-456c-95e8-a3a3e1bf196a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:56.319334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd77ea-6f70-456c-95e8-a3a3e1bf196a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:56.348124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:56.355184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed767ae-a793-40fd-bd1c-2fe8c9902b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:56.355995 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed767ae-a793-40fd-bd1c-2fe8c9902b79 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:56.356276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed767ae-a793-40fd-bd1c-2fe8c9902b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:56.356555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed767ae-a793-40fd-bd1c-2fe8c9902b79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:56.367624 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed767ae-a793-40fd-bd1c-2fe8c9902b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1ed767ae-a793-40fd-bd1c-2fe8c9902b79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:56.375817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:56.376773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:00:56.377629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:56.382525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 505/1023] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Jul 11 14:00:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:56.383542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c93cd4-1ce0-4c5e-a5e6-0003d36b95f8 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:56.402493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:56.486991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c93cd4-1ce0-4c5e-a5e6-0003d36b95f8 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:56.537330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04e737-2856-4811-9343-828fda412b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:56.538086 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04e737-2856-4811-9343-828fda412b0f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:56.538409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04e737-2856-4811-9343-828fda412b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:56.539328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04e737-2856-4811-9343-828fda412b0f None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:56.540116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04e737-2856-4811-9343-828fda412b0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:56.540501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04e737-2856-4811-9343-828fda412b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:56.541898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04e737-2856-4811-9343-828fda412b0f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:56.549792 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5afad9-0897-4141-a596-467234d9b8c5 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:56.550083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5afad9-0897-4141-a596-467234d9b8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:56.550395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5afad9-0897-4141-a596-467234d9b8c5 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:56.556540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 519/1024] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Jul 11 14:00:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:56.556731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 506/1025] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:56.558840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5afad9-0897-4141-a596-467234d9b8c5 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:56.559086 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29b897-0a76-4fe6-9833-42652b6dde6c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:56.559513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29b897-0a76-4fe6-9833-42652b6dde6c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:56.559935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29b897-0a76-4fe6-9833-42652b6dde6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:56.584313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-fa29b897-0a76-4fe6-9833-42652b6dde6c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:56.585942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fa29b897-0a76-4fe6-9833-42652b6dde6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:56.666289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 520/1026] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:56.681472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5afad9-0897-4141-a596-467234d9b8c5 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:56.690913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29b897-0a76-4fe6-9833-42652b6dde6c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:56.703820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:56.718518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beee4ca-9b6d-4559-a710-62dc1da218dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:56.719155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beee4ca-9b6d-4559-a710-62dc1da218dd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:56.719443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beee4ca-9b6d-4559-a710-62dc1da218dd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:56.719726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beee4ca-9b6d-4559-a710-62dc1da218dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:56.731001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beee4ca-9b6d-4559-a710-62dc1da218dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:56.732474 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beee4ca-9b6d-4559-a710-62dc1da218dd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0beee4ca-9b6d-4559-a710-62dc1da218dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:56.750837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:56.751765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:56.752660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:56.752660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:56.752660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:56.752660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:56.752660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 507/1027] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:56.758346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beee4ca-9b6d-4559-a710-62dc1da218dd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:56.802025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29b897-0a76-4fe6-9833-42652b6dde6c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:56.803579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:56.845288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36e1e-4bd2-4200-bb5e-48f912246fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:56.846093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36e1e-4bd2-4200-bb5e-48f912246fba None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:56.846785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36e1e-4bd2-4200-bb5e-48f912246fba None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:56.846785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36e1e-4bd2-4200-bb5e-48f912246fba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:56.847859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36e1e-4bd2-4200-bb5e-48f912246fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:56.849874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36e1e-4bd2-4200-bb5e-48f912246fba None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:56.851710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 521/1028] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:56.857557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36e1e-4bd2-4200-bb5e-48f912246fba None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:56.877441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beee4ca-9b6d-4559-a710-62dc1da218dd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:56.924791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a624c-917a-48cb-b34b-90b73db2a752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:56.925376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a624c-917a-48cb-b34b-90b73db2a752 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:56.925661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a624c-917a-48cb-b34b-90b73db2a752 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:56.925941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a624c-917a-48cb-b34b-90b73db2a752 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:56.926709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a624c-917a-48cb-b34b-90b73db2a752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:56.927015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a624c-917a-48cb-b34b-90b73db2a752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:56.929153 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a624c-917a-48cb-b34b-90b73db2a752 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:56.940765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 508/1029] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:56.946650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a624c-917a-48cb-b34b-90b73db2a752 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:56.947162 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:56.971310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36e1e-4bd2-4200-bb5e-48f912246fba None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:57.010091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e17967-3813-4519-84f7-2bf83682b76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:57.010827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e17967-3813-4519-84f7-2bf83682b76a None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:57.011146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e17967-3813-4519-84f7-2bf83682b76a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:57.011453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e17967-3813-4519-84f7-2bf83682b76a None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:57.012188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e17967-3813-4519-84f7-2bf83682b76a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:57.013685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e17967-3813-4519-84f7-2bf83682b76a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:57.037964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 522/1030] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 14:00:56 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:00:57.060258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a624c-917a-48cb-b34b-90b73db2a752 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:57.062365 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:57.102132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346b3a8-2881-443f-901c-f57462144963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:57.102973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346b3a8-2881-443f-901c-f57462144963 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:57.103252 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346b3a8-2881-443f-901c-f57462144963 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:57.103530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346b3a8-2881-443f-901c-f57462144963 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:57.112021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346b3a8-2881-443f-901c-f57462144963 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:57.113500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346b3a8-2881-443f-901c-f57462144963 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0346b3a8-2881-443f-901c-f57462144963 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:00:57.130992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:57.132077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:57.138551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:57.138551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:57.138551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:00:57.138551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:00:57.138551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:00:57.138551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:00:57.138551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:00:57.138551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:00:57.138551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:00:57.138551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:57.138551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 509/1031] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 11 14:00:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:57.139201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e17967-3813-4519-84f7-2bf83682b76a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:57.257711 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e17967-3813-4519-84f7-2bf83682b76a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:57.296340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9d7bc-5518-491e-8ff8-558809190ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:57.297419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9d7bc-5518-491e-8ff8-558809190ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:57.297915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9d7bc-5518-491e-8ff8-558809190ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:57.298450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9d7bc-5518-491e-8ff8-558809190ab6 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:57.299528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9d7bc-5518-491e-8ff8-558809190ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:57.299950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9d7bc-5518-491e-8ff8-558809190ab6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:57.301401 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9d7bc-5518-491e-8ff8-558809190ab6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:57.304702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:57.323520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 523/1032] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 11 14:00:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:57.329108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346b3a8-2881-443f-901c-f57462144963 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:57.437323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346b3a8-2881-443f-901c-f57462144963 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:57.472859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83388c49-0af0-4e7b-a7c8-d5080c683e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:57.473495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83388c49-0af0-4e7b-a7c8-d5080c683e91 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:57.473779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83388c49-0af0-4e7b-a7c8-d5080c683e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:57.474083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83388c49-0af0-4e7b-a7c8-d5080c683e91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:57.506147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:57.524464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686359a2-47f9-40e6-a477-12a49e729f7d None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:57.524766 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686359a2-47f9-40e6-a477-12a49e729f7d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:57.525056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686359a2-47f9-40e6-a477-12a49e729f7d None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:57.526610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 524/1033] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:00:57.531549 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba5874-1b12-4f08-937e-a63f88fb2c7a None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:57.531839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba5874-1b12-4f08-937e-a63f88fb2c7a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:57.532120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba5874-1b12-4f08-937e-a63f88fb2c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:57.548824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83388c49-0af0-4e7b-a7c8-d5080c683e91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:57.549253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-3eba5874-1b12-4f08-937e-a63f88fb2c7a None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:57.550325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83388c49-0af0-4e7b-a7c8-d5080c683e91 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:57.550502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3eba5874-1b12-4f08-937e-a63f88fb2c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:57.628829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 525/1034] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:00:57.652076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba5874-1b12-4f08-937e-a63f88fb2c7a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:57.664269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 510/1035] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:00:57.670172 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83388c49-0af0-4e7b-a7c8-d5080c683e91 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:57.736498 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:57.765669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba5874-1b12-4f08-937e-a63f88fb2c7a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:57.783395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83388c49-0af0-4e7b-a7c8-d5080c683e91 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:57.791487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:57.806755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32867183-1494-404d-9edc-e39aaba06f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:57.807568 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32867183-1494-404d-9edc-e39aaba06f1b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:57.807855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32867183-1494-404d-9edc-e39aaba06f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:57.808135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32867183-1494-404d-9edc-e39aaba06f1b None admin] PATH_INFO: `/v3/services/image` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:57.808796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32867183-1494-404d-9edc-e39aaba06f1b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:57.810193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32867183-1494-404d-9edc-e39aaba06f1b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:57.820921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040acf59-9e97-4a50-bf05-c93e374880d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:57.821725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040acf59-9e97-4a50-bf05-c93e374880d1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:57.822008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040acf59-9e97-4a50-bf05-c93e374880d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:57.822320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040acf59-9e97-4a50-bf05-c93e374880d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-32867183-1494-404d-9edc-e39aaba06f1b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:57.822670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:57.823637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:57.824485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 526/1036] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Jul 11 14:00:57 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:57.829752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32867183-1494-404d-9edc-e39aaba06f1b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:57.837477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040acf59-9e97-4a50-bf05-c93e374880d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:57.838971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040acf59-9e97-4a50-bf05-c93e374880d1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-040acf59-9e97-4a50-bf05-c93e374880d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:00:57.858289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:57.859433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:57.860574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:00:57.860574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:00:57.860574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:00:57.860574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:57.860997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 511/1037] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:57.867175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040acf59-9e97-4a50-bf05-c93e374880d1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:57.948043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32867183-1494-404d-9edc-e39aaba06f1b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:57.971880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040acf59-9e97-4a50-bf05-c93e374880d1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:57.986203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:57.987714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db484c1-27e3-4a8a-8434-de2910337158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:57.988422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db484c1-27e3-4a8a-8434-de2910337158 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:57.989569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db484c1-27e3-4a8a-8434-de2910337158 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:57.990610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db484c1-27e3-4a8a-8434-de2910337158 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:57.991763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db484c1-27e3-4a8a-8434-de2910337158 None admin] RBAC: Adding query filter params (name=image) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:57.992278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db484c1-27e3-4a8a-8434-de2910337158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:57.994050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db484c1-27e3-4a8a-8434-de2910337158 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:58.004490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 527/1038] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:58.006230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db484c1-27e3-4a8a-8434-de2910337158 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:58.008177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cc336-60a5-4f90-a4cb-6cf172e52470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:58.008859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc336-60a5-4f90-a4cb-6cf172e52470 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:58.009142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc336-60a5-4f90-a4cb-6cf172e52470 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:58.009418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cc336-60a5-4f90-a4cb-6cf172e52470 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:58.010181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cc336-60a5-4f90-a4cb-6cf172e52470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:58.010489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cc336-60a5-4f90-a4cb-6cf172e52470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:58.012360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cc336-60a5-4f90-a4cb-6cf172e52470 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:58.029331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 512/1039] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:58.031310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cc336-60a5-4f90-a4cb-6cf172e52470 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:58.064851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:58.123386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db484c1-27e3-4a8a-8434-de2910337158 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:58.145267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cc336-60a5-4f90-a4cb-6cf172e52470 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:58.166122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ba7b9-9d75-430f-8e62-7ddfc8992c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:58.166755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ba7b9-9d75-430f-8e62-7ddfc8992c21 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:58.167052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ba7b9-9d75-430f-8e62-7ddfc8992c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:58.167336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ba7b9-9d75-430f-8e62-7ddfc8992c21 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:58.168058 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ba7b9-9d75-430f-8e62-7ddfc8992c21 None admin] RBAC: Adding query filter params (type=image) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:58.168386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ba7b9-9d75-430f-8e62-7ddfc8992c21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:58.169745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ba7b9-9d75-430f-8e62-7ddfc8992c21 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:58.180025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 528/1040] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:00:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:58.181106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ba7b9-9d75-430f-8e62-7ddfc8992c21 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:58.186138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34960c-f1e2-4a0d-b240-500421ed08ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:58.186973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34960c-f1e2-4a0d-b240-500421ed08ee None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:58.187257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34960c-f1e2-4a0d-b240-500421ed08ee None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:58.187531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34960c-f1e2-4a0d-b240-500421ed08ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:58.195498 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34960c-f1e2-4a0d-b240-500421ed08ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:58.196989 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34960c-f1e2-4a0d-b240-500421ed08ee None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2f34960c-f1e2-4a0d-b240-500421ed08ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:00:58.213819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:58.215351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:58.216690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:00:58.216690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:00:58.216690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:00:58.216690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:00:58.216690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:00:58.216690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:00:58.216690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:00:58.216690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:00:58.219670 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 513/1041] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:00:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:00:58.221642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34960c-f1e2-4a0d-b240-500421ed08ee None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:58.263940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:58.314395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ba7b9-9d75-430f-8e62-7ddfc8992c21 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:58.329462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:58.345980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34960c-f1e2-4a0d-b240-500421ed08ee None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:58.351636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bd1ed-c189-4904-9b55-64b8e63edd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:58.352487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bd1ed-c189-4904-9b55-64b8e63edd34 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:58.352770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bd1ed-c189-4904-9b55-64b8e63edd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:58.353047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bd1ed-c189-4904-9b55-64b8e63edd34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:58.353845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bd1ed-c189-4904-9b55-64b8e63edd34 None admin] RBAC: Adding query filter params (interface=public, service_id=edd1cca325fb48e99e8ec4ff411ad658, region_id=RegionOne) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:58.354173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bd1ed-c189-4904-9b55-64b8e63edd34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:58.355555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bd1ed-c189-4904-9b55-64b8e63edd34 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:58.361300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 529/1042] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 11 14:00:58 2022] GET /identity/v3/endpoints?service_id=edd1cca325fb48e99e8ec4ff411ad658&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:58.367775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bd1ed-c189-4904-9b55-64b8e63edd34 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:58.384237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ebea1-fcee-49b6-bcc3-09021c1ac588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:58.385749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ebea1-fcee-49b6-bcc3-09021c1ac588 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:58.385749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ebea1-fcee-49b6-bcc3-09021c1ac588 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:58.385749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ebea1-fcee-49b6-bcc3-09021c1ac588 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:58.386255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ebea1-fcee-49b6-bcc3-09021c1ac588 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:58.386558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ebea1-fcee-49b6-bcc3-09021c1ac588 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:58.387990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ebea1-fcee-49b6-bcc3-09021c1ac588 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:58.404978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 514/1043] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:00:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:58.406706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ebea1-fcee-49b6-bcc3-09021c1ac588 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:58.490565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bd1ed-c189-4904-9b55-64b8e63edd34 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:58.510188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:58.517943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ebea1-fcee-49b6-bcc3-09021c1ac588 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:58.527160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b30e2-d724-4654-bd42-4471e3295104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:58.528102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b30e2-d724-4654-bd42-4471e3295104 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:58.528591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b30e2-d724-4654-bd42-4471e3295104 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:58.529072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b30e2-d724-4654-bd42-4471e3295104 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:58.529763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b30e2-d724-4654-bd42-4471e3295104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:58.531166 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b30e2-d724-4654-bd42-4471e3295104 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:58.542775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 530/1044] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 11 14:00:58 2022] GET /identity/v3/services => generated 1957 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:00:58.555680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b25ac3-9737-42df-a00a-59305dd41d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:58.556370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b25ac3-9737-42df-a00a-59305dd41d54 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:58.556659 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b25ac3-9737-42df-a00a-59305dd41d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:58.556925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b25ac3-9737-42df-a00a-59305dd41d54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:58.557814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b25ac3-9737-42df-a00a-59305dd41d54 None admin] RBAC: Adding query filter params (role.id=b4157aafaef74a9fbbe56bae19de8b02, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=38a31386700941c9b103720a64bac405) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:58.558249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b25ac3-9737-42df-a00a-59305dd41d54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:58.560059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b25ac3-9737-42df-a00a-59305dd41d54 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:58.566822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 515/1045] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:00:58 2022] GET /identity/v3/role_assignments?user.id=38a31386700941c9b103720a64bac405&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=b4157aafaef74a9fbbe56bae19de8b02 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:59.188559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e868b-9b8a-4ce7-8d71-d67235003b8e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:59.188908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e868b-9b8a-4ce7-8d71-d67235003b8e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:59.189125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e868b-9b8a-4ce7-8d71-d67235003b8e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:59.190576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 531/1046] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:00:59.198367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfaaf7-126f-498f-bdbc-0ce838fa0e98 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:59.198367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfaaf7-126f-498f-bdbc-0ce838fa0e98 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:59.198367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfaaf7-126f-498f-bdbc-0ce838fa0e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:59.218512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-38bfaaf7-126f-498f-bdbc-0ce838fa0e98 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:00:59.219787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-38bfaaf7-126f-498f-bdbc-0ce838fa0e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:00:59.291349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 516/1047] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:00:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:00:59.314674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e868b-9b8a-4ce7-8d71-d67235003b8e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:59.361497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:59.421868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e868b-9b8a-4ce7-8d71-d67235003b8e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:59.456396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c236-2dcf-4876-8e83-dd12dbf6fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:59.457112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c236-2dcf-4876-8e83-dd12dbf6fd53 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:59.457396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c236-2dcf-4876-8e83-dd12dbf6fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:59.457671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537c236-2dcf-4876-8e83-dd12dbf6fd53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:59.468417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537c236-2dcf-4876-8e83-dd12dbf6fd53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-f537c236-2dcf-4876-8e83-dd12dbf6fd53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:00:59.475995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:00:59.476939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:00:59.482846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 532/1048] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:00:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:00:59.483580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfaaf7-126f-498f-bdbc-0ce838fa0e98 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:59.572092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:59.585461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfaaf7-126f-498f-bdbc-0ce838fa0e98 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:59.620635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aa868-9f59-4a70-8a4c-11ad036462d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:59.621304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aa868-9f59-4a70-8a4c-11ad036462d9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:59.621584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aa868-9f59-4a70-8a4c-11ad036462d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:59.621859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26aa868-9f59-4a70-8a4c-11ad036462d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:59.622653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aa868-9f59-4a70-8a4c-11ad036462d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:00:59.622957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aa868-9f59-4a70-8a4c-11ad036462d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:59.624328 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26aa868-9f59-4a70-8a4c-11ad036462d9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:59.637738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 517/1049] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:00:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:00:59.639037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c236-2dcf-4876-8e83-dd12dbf6fd53 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:59.755403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537c236-2dcf-4876-8e83-dd12dbf6fd53 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:59.757799 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:00:59.798526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea612d0-4cea-4e4b-82c3-4b0717b257b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:59.799457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea612d0-4cea-4e4b-82c3-4b0717b257b2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:59.799770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea612d0-4cea-4e4b-82c3-4b0717b257b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:59.800052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea612d0-4cea-4e4b-82c3-4b0717b257b2 None admin] PATH_INFO: `/v3/users/8929ead00dfc469e88ed1a37450fbaee` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:59.815028 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea612d0-4cea-4e4b-82c3-4b0717b257b2 None admin] RBAC: Authorizing `identity:get_user(user_id=8929ead00dfc469e88ed1a37450fbaee)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:00:59.816582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea612d0-4cea-4e4b-82c3-4b0717b257b2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:00:59.822235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 533/1050] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:00:59 2022] GET /identity/v3/users/8929ead00dfc469e88ed1a37450fbaee => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:00:59.824575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aa868-9f59-4a70-8a4c-11ad036462d9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:00:59.930404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26aa868-9f59-4a70-8a4c-11ad036462d9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:00:59.968928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36728515-e54e-4aa2-94a5-41dd29f097b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:00:59.969586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36728515-e54e-4aa2-94a5-41dd29f097b2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:00:59.969873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36728515-e54e-4aa2-94a5-41dd29f097b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:00:59.970170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36728515-e54e-4aa2-94a5-41dd29f097b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:00:59.989471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:00.041323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36728515-e54e-4aa2-94a5-41dd29f097b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:00.042757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36728515-e54e-4aa2-94a5-41dd29f097b2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:00.149925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 518/1051] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:00:59 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:01:00.151622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea612d0-4cea-4e4b-82c3-4b0717b257b2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:00.261252 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea612d0-4cea-4e4b-82c3-4b0717b257b2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:00.301666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c6495-a639-4b45-8954-16094cc5e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:00.302758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c6495-a639-4b45-8954-16094cc5e134 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:00.303123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c6495-a639-4b45-8954-16094cc5e134 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:00.303403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c6495-a639-4b45-8954-16094cc5e134 None admin] PATH_INFO: `/v3/projects/b6ab499e09344f6e9165fb6cff1eec42` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:00.304615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c6495-a639-4b45-8954-16094cc5e134 None admin] RBAC: Authorizing `identity:get_project(project_id=b6ab499e09344f6e9165fb6cff1eec42)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:00.306049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c6495-a639-4b45-8954-16094cc5e134 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:00.307989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 534/1052] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:00 2022] GET /identity/v3/projects/b6ab499e09344f6e9165fb6cff1eec42 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:00.313891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36728515-e54e-4aa2-94a5-41dd29f097b2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:00.365776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:00.416894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36728515-e54e-4aa2-94a5-41dd29f097b2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:00.451547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9014e43-332b-4932-ae0c-0aecb88f06f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:00.452202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9014e43-332b-4932-ae0c-0aecb88f06f5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:00.452483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9014e43-332b-4932-ae0c-0aecb88f06f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:00.452758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9014e43-332b-4932-ae0c-0aecb88f06f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:00.453590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9014e43-332b-4932-ae0c-0aecb88f06f5 None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=b6ab499e09344f6e9165fb6cff1eec42, user.id=8929ead00dfc469e88ed1a37450fbaee) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:00.453898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9014e43-332b-4932-ae0c-0aecb88f06f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:00.455355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9014e43-332b-4932-ae0c-0aecb88f06f5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:00.466223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 519/1053] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:01:00 2022] GET /identity/v3/role_assignments?user.id=8929ead00dfc469e88ed1a37450fbaee&scope.project.id=b6ab499e09344f6e9165fb6cff1eec42&role.id=57f1335a97b5490cb0853894c2faf62c => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:00.631765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1612afc-72b1-4d13-81c0-be50c20715aa None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:00.632276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1612afc-72b1-4d13-81c0-be50c20715aa None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:00.632639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1612afc-72b1-4d13-81c0-be50c20715aa None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:00.635332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 535/1054] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:00.641041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc01b3-f3de-4512-a1cc-44bacc6d3bd6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:00.641511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc01b3-f3de-4512-a1cc-44bacc6d3bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:00.641613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc01b3-f3de-4512-a1cc-44bacc6d3bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:00.658929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-14bc01b3-f3de-4512-a1cc-44bacc6d3bd6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:00.660127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-14bc01b3-f3de-4512-a1cc-44bacc6d3bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:00.685731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5f4e8-ceea-438d-9649-19678720f10a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:00.686025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5f4e8-ceea-438d-9649-19678720f10a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:00.686339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5f4e8-ceea-438d-9649-19678720f10a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:00.687732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 536/1055] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:00.693067 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7a3b-c16f-4fda-a7ce-1323d7671449 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:00.693561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7a3b-c16f-4fda-a7ce-1323d7671449 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:00.693948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f7a3b-c16f-4fda-a7ce-1323d7671449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:00.714065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-534f7a3b-c16f-4fda-a7ce-1323d7671449 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:00.715963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-534f7a3b-c16f-4fda-a7ce-1323d7671449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:00.741030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 520/1056] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:00.744184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:00.764425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc01b3-f3de-4512-a1cc-44bacc6d3bd6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:00.796851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 537/1057] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:01:00.814714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:00.820324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f7a3b-c16f-4fda-a7ce-1323d7671449 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:00.876026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc01b3-f3de-4512-a1cc-44bacc6d3bd6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:00.914919 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d95a-3fc8-4747-a74e-e1b235595b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:00.915745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d95a-3fc8-4747-a74e-e1b235595b25 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:00.916032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d95a-3fc8-4747-a74e-e1b235595b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:00.916301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d95a-3fc8-4747-a74e-e1b235595b25 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:00.926801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2d95a-3fc8-4747-a74e-e1b235595b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:01:00.934931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f7a3b-c16f-4fda-a7ce-1323d7671449 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-58c2d95a-3fc8-4747-a74e-e1b235595b25 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:01:00.935171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:00.936090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:01:00.936946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 521/1058] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Jul 11 14:01:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:01:00.942392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d95a-3fc8-4747-a74e-e1b235595b25 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:00.975451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763c433-d0aa-4946-84f8-b3ed8e25e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:00.976217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763c433-d0aa-4946-84f8-b3ed8e25e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:00.976511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763c433-d0aa-4946-84f8-b3ed8e25e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:00.976793 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763c433-d0aa-4946-84f8-b3ed8e25e5b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:00.977485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763c433-d0aa-4946-84f8-b3ed8e25e5b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:00.978898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763c433-d0aa-4946-84f8-b3ed8e25e5b7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-6763c433-d0aa-4946-84f8-b3ed8e25e5b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:01.005662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:01.007885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:01.009557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 538/1059] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Jul 11 14:01:00 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:01:01.017178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763c433-d0aa-4946-84f8-b3ed8e25e5b7 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:01.046197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:01.078656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d95a-3fc8-4747-a74e-e1b235595b25 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:01.082052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:01.117347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec7e79-ad16-45c7-bdd4-c3ba6c48dd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:01.118032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7e79-ad16-45c7-bdd4-c3ba6c48dd53 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:01.118377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7e79-ad16-45c7-bdd4-c3ba6c48dd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:01.118682 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec7e79-ad16-45c7-bdd4-c3ba6c48dd53 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:01.119440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec7e79-ad16-45c7-bdd4-c3ba6c48dd53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:01.119756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec7e79-ad16-45c7-bdd4-c3ba6c48dd53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:01.121140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec7e79-ad16-45c7-bdd4-c3ba6c48dd53 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:01.129546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763c433-d0aa-4946-84f8-b3ed8e25e5b7 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:01.135090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 522/1060] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Jul 11 14:01:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:01:01.136342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec7e79-ad16-45c7-bdd4-c3ba6c48dd53 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:01.172187 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5a58c-115b-42b3-8bab-f670636a3b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:01.172778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a58c-115b-42b3-8bab-f670636a3b55 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:01.173068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a58c-115b-42b3-8bab-f670636a3b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:01.173355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a58c-115b-42b3-8bab-f670636a3b55 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:01.174075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5a58c-115b-42b3-8bab-f670636a3b55 None admin] RBAC: Adding query filter params (name=image) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:01.174493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5a58c-115b-42b3-8bab-f670636a3b55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:01.175872 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5a58c-115b-42b3-8bab-f670636a3b55 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:01.185956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 539/1061] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:01:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:01:01.187001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5a58c-115b-42b3-8bab-f670636a3b55 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:01.259302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec7e79-ad16-45c7-bdd4-c3ba6c48dd53 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:01.285318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:01.301147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fdf12-c254-4932-afa3-d974d0e07f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:01.301645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5a58c-115b-42b3-8bab-f670636a3b55 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:01.301948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fdf12-c254-4932-afa3-d974d0e07f4f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:01.302330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fdf12-c254-4932-afa3-d974d0e07f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:01.302793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fdf12-c254-4932-afa3-d974d0e07f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:01.314951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fdf12-c254-4932-afa3-d974d0e07f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:01.316546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fdf12-c254-4932-afa3-d974d0e07f4f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-5b4fdf12-c254-4932-afa3-d974d0e07f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:01:01.336452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:01.337622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:01.338565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:01:01.338565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:01:01.338565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:01:01.338565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:01:01.338565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 523/1062] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:01.343210 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fdf12-c254-4932-afa3-d974d0e07f4f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:01.343588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaded5-5294-4894-92a3-b8c39a2d5c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:01.344271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaded5-5294-4894-92a3-b8c39a2d5c0b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:01.344563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaded5-5294-4894-92a3-b8c39a2d5c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:01.344847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaded5-5294-4894-92a3-b8c39a2d5c0b None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:01.345578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deaded5-5294-4894-92a3-b8c39a2d5c0b None admin] RBAC: Adding query filter params (type=image) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:01.345881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deaded5-5294-4894-92a3-b8c39a2d5c0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:01.347305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deaded5-5294-4894-92a3-b8c39a2d5c0b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:01.352546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 540/1063] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:01:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:01.358108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaded5-5294-4894-92a3-b8c39a2d5c0b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:01.372051 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:01.461587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaded5-5294-4894-92a3-b8c39a2d5c0b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:01.464193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fdf12-c254-4932-afa3-d974d0e07f4f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:01.495609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f20ecf-f21c-45c4-b1e9-06d0f8076bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:01.496284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f20ecf-f21c-45c4-b1e9-06d0f8076bf5 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:01.496572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f20ecf-f21c-45c4-b1e9-06d0f8076bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:01.496850 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f20ecf-f21c-45c4-b1e9-06d0f8076bf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:01.497596 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f20ecf-f21c-45c4-b1e9-06d0f8076bf5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:01.499007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f20ecf-f21c-45c4-b1e9-06d0f8076bf5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:01.499600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf62adc-98df-412b-9f08-1093298a713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:01.500319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62adc-98df-412b-9f08-1093298a713b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:01.500611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62adc-98df-412b-9f08-1093298a713b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:01.500900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf62adc-98df-412b-9f08-1093298a713b None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:01.501624 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf62adc-98df-412b-9f08-1093298a713b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:01.501935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf62adc-98df-412b-9f08-1093298a713b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:01.503595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf62adc-98df-412b-9f08-1093298a713b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:01.521952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 524/1064] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:01:01.522140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 541/1065] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 11 14:01:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:01:01.527155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf62adc-98df-412b-9f08-1093298a713b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:01.620435 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:01.646289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf62adc-98df-412b-9f08-1093298a713b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:01.692410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce0c6a-3261-411d-99bb-f9aff78ca838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:01.694051 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce0c6a-3261-411d-99bb-f9aff78ca838 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:01.694362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce0c6a-3261-411d-99bb-f9aff78ca838 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:01.694641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce0c6a-3261-411d-99bb-f9aff78ca838 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:01.702213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce0c6a-3261-411d-99bb-f9aff78ca838 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:01.703653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce0c6a-3261-411d-99bb-f9aff78ca838 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e8ce0c6a-3261-411d-99bb-f9aff78ca838 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:01:01.718816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:01.719987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:01.721154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:01.721154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:01.721154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:01:01.721154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:01:01.721154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:01:01.721154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:01:01.721154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:01:01.721154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:01:01.721154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:01:01.721154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:01:01.721154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 525/1066] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 11 14:01:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:01.726670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f20ecf-f21c-45c4-b1e9-06d0f8076bf5 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:01.736113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:01.842247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f20ecf-f21c-45c4-b1e9-06d0f8076bf5 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:01.883867 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4fb51-a7c6-4708-b2e6-92d99e324be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:01.884856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4fb51-a7c6-4708-b2e6-92d99e324be7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:01.885324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4fb51-a7c6-4708-b2e6-92d99e324be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:01.885754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4fb51-a7c6-4708-b2e6-92d99e324be7 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:01.886866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4fb51-a7c6-4708-b2e6-92d99e324be7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:01.887382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4fb51-a7c6-4708-b2e6-92d99e324be7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:01.888973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4fb51-a7c6-4708-b2e6-92d99e324be7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:01.908391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 542/1067] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 11 14:01:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:01.913950 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce0c6a-3261-411d-99bb-f9aff78ca838 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:02.017425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce0c6a-3261-411d-99bb-f9aff78ca838 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:02.060138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723bad-6d4d-4902-a8ca-8b96945fdec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:02.060934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723bad-6d4d-4902-a8ca-8b96945fdec5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:02.061214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723bad-6d4d-4902-a8ca-8b96945fdec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:02.061484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723bad-6d4d-4902-a8ca-8b96945fdec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:02.063755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:02.074719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f723bad-6d4d-4902-a8ca-8b96945fdec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:02.076183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f723bad-6d4d-4902-a8ca-8b96945fdec5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7f723bad-6d4d-4902-a8ca-8b96945fdec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:01:02.094450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:02.095437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:02.102042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:01:02.102042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:01:02.102042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:01:02.102042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:01:02.102042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 526/1068] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:02.103876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4fb51-a7c6-4708-b2e6-92d99e324be7 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:02.171310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:02.222249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4fb51-a7c6-4708-b2e6-92d99e324be7 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:02.264192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353258a-69bc-450a-85d4-5558b9ac4003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:02.265063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353258a-69bc-450a-85d4-5558b9ac4003 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:02.265448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353258a-69bc-450a-85d4-5558b9ac4003 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:02.265887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353258a-69bc-450a-85d4-5558b9ac4003 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:02.266939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353258a-69bc-450a-85d4-5558b9ac4003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:02.267363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353258a-69bc-450a-85d4-5558b9ac4003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:02.269319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353258a-69bc-450a-85d4-5558b9ac4003 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:02.290042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 543/1069] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:02.291820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723bad-6d4d-4902-a8ca-8b96945fdec5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:02.396843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723bad-6d4d-4902-a8ca-8b96945fdec5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:02.433520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551ed9d-06a7-46f7-ba58-84a06a1f009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:02.434358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ed9d-06a7-46f7-ba58-84a06a1f009c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:02.434646 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ed9d-06a7-46f7-ba58-84a06a1f009c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:02.434924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551ed9d-06a7-46f7-ba58-84a06a1f009c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:02.441727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551ed9d-06a7-46f7-ba58-84a06a1f009c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:02.443246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551ed9d-06a7-46f7-ba58-84a06a1f009c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2551ed9d-06a7-46f7-ba58-84a06a1f009c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:01:02.457016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:02.457920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:02.459809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:01:02.459809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:01:02.459809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:01:02.459809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:01:02.459809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:01:02.459809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:01:02.459809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:01:02.459809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:01:02.462480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 527/1070] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:01:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:02.464648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353258a-69bc-450a-85d4-5558b9ac4003 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:02.514754 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0484e-2799-4985-82cb-0ffbff1bd9f8 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:02.515043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0484e-2799-4985-82cb-0ffbff1bd9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:02.515321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0484e-2799-4985-82cb-0ffbff1bd9f8 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:02.516807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 528/1071] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:01:02.522459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ce016-3dbd-4440-bfb5-ae55c92dae21 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:02.522671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ce016-3dbd-4440-bfb5-ae55c92dae21 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:02.522892 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ce016-3dbd-4440-bfb5-ae55c92dae21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:02.540031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-572ce016-3dbd-4440-bfb5-ae55c92dae21 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:02.541220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-572ce016-3dbd-4440-bfb5-ae55c92dae21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:02.572207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353258a-69bc-450a-85d4-5558b9ac4003 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:02.584352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:02.598838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:02.612914 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c6162-b31d-4b3c-a5b0-b6898669064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:02.613676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c6162-b31d-4b3c-a5b0-b6898669064f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:02.613967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c6162-b31d-4b3c-a5b0-b6898669064f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:02.614275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c6162-b31d-4b3c-a5b0-b6898669064f None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:02.615416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c6162-b31d-4b3c-a5b0-b6898669064f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:02.615700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c6162-b31d-4b3c-a5b0-b6898669064f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:02.617147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c6162-b31d-4b3c-a5b0-b6898669064f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:02.622513 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 529/1072] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:01:02.634206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 544/1073] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:02.636422 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ce016-3dbd-4440-bfb5-ae55c92dae21 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:02.636774 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c6162-b31d-4b3c-a5b0-b6898669064f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:02.747915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c6162-b31d-4b3c-a5b0-b6898669064f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:02.750959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ce016-3dbd-4440-bfb5-ae55c92dae21 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:02.788140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8764e-1e6e-43d2-9870-ea3463be5b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:02.788677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4660d-1d93-4f09-9d3c-4a0a08912091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:02.788956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8764e-1e6e-43d2-9870-ea3463be5b98 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:02.789254 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8764e-1e6e-43d2-9870-ea3463be5b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:02.789477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4660d-1d93-4f09-9d3c-4a0a08912091 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:02.789577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8764e-1e6e-43d2-9870-ea3463be5b98 None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/38a31386700941c9b103720a64bac405/roles/b4157aafaef74a9fbbe56bae19de8b02` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:02.789759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4660d-1d93-4f09-9d3c-4a0a08912091 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:02.790059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4660d-1d93-4f09-9d3c-4a0a08912091 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:02.791907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8764e-1e6e-43d2-9870-ea3463be5b98 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=38a31386700941c9b103720a64bac405, role_id=b4157aafaef74a9fbbe56bae19de8b02)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:02.793342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8764e-1e6e-43d2-9870-ea3463be5b98 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:02.802273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4660d-1d93-4f09-9d3c-4a0a08912091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:01:02.807981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 530/1074] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:01:02 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/38a31386700941c9b103720a64bac405/roles/b4157aafaef74a9fbbe56bae19de8b02 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-33d4660d-1d93-4f09-9d3c-4a0a08912091 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:01:02.810606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:02.811587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:02.812471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:02.817156 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 545/1075] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:01:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:02.819294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8764e-1e6e-43d2-9870-ea3463be5b98 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:02.861708 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:02.939116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8764e-1e6e-43d2-9870-ea3463be5b98 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:02.979572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeef3d-28f1-4fe8-8156-1a2773fc68be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:02.980248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeef3d-28f1-4fe8-8156-1a2773fc68be None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:02.980528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeef3d-28f1-4fe8-8156-1a2773fc68be None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:02.980802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeef3d-28f1-4fe8-8156-1a2773fc68be None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:02.981581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeef3d-28f1-4fe8-8156-1a2773fc68be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:02.981884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeef3d-28f1-4fe8-8156-1a2773fc68be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:02.983324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeef3d-28f1-4fe8-8156-1a2773fc68be None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:02.992770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 531/1076] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:02.998565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4660d-1d93-4f09-9d3c-4a0a08912091 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:03.048276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:03.112495 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4660d-1d93-4f09-9d3c-4a0a08912091 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:03.148846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97973d2-42e8-4fc5-862e-4c79640805ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:03.149836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97973d2-42e8-4fc5-862e-4c79640805ad None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:03.150217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97973d2-42e8-4fc5-862e-4c79640805ad None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:03.150574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97973d2-42e8-4fc5-862e-4c79640805ad None admin] PATH_INFO: `/v3/users/8929ead00dfc469e88ed1a37450fbaee` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:03.151926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97973d2-42e8-4fc5-862e-4c79640805ad None admin] RBAC: Authorizing `identity:get_user(user_id=8929ead00dfc469e88ed1a37450fbaee)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:03.153463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97973d2-42e8-4fc5-862e-4c79640805ad None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:03.155469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 546/1077] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:02 2022] GET /identity/v3/users/8929ead00dfc469e88ed1a37450fbaee => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:03.161527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeef3d-28f1-4fe8-8156-1a2773fc68be None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:03.273232 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:03.277399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeef3d-28f1-4fe8-8156-1a2773fc68be None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:03.315855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3725-69d9-443b-942e-b80051877a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:03.316806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3725-69d9-443b-942e-b80051877a0f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:03.317269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3725-69d9-443b-942e-b80051877a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:03.317682 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3725-69d9-443b-942e-b80051877a0f None admin] PATH_INFO: `/v3/projects/b6ab499e09344f6e9165fb6cff1eec42` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:03.319556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec3725-69d9-443b-942e-b80051877a0f None admin] RBAC: Authorizing `identity:get_project(project_id=b6ab499e09344f6e9165fb6cff1eec42)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:03.321073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec3725-69d9-443b-942e-b80051877a0f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:03.328285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 532/1078] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:03 2022] GET /identity/v3/projects/b6ab499e09344f6e9165fb6cff1eec42 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:03.329509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97973d2-42e8-4fc5-862e-4c79640805ad None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:03.435776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97973d2-42e8-4fc5-862e-4c79640805ad None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:03.450120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:03.473041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe632d-3699-43c7-9a39-df203fccfdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:03.473973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe632d-3699-43c7-9a39-df203fccfdb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:03.474898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe632d-3699-43c7-9a39-df203fccfdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:03.475396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe632d-3699-43c7-9a39-df203fccfdb8 None admin] PATH_INFO: `/v3/projects/b6ab499e09344f6e9165fb6cff1eec42/users/8929ead00dfc469e88ed1a37450fbaee/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:03.477387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe632d-3699-43c7-9a39-df203fccfdb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ab499e09344f6e9165fb6cff1eec42, user_id=8929ead00dfc469e88ed1a37450fbaee, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:03.478845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe632d-3699-43c7-9a39-df203fccfdb8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:03.492648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 547/1079] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:01:03 2022] PUT /identity/v3/projects/b6ab499e09344f6e9165fb6cff1eec42/users/8929ead00dfc469e88ed1a37450fbaee/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:01:03.718914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2685ff9-143f-4450-890e-524066363c0e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:03.719265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2685ff9-143f-4450-890e-524066363c0e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:03.719542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2685ff9-143f-4450-890e-524066363c0e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:03.720949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 533/1080] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:03.726374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc219-f4fb-49cc-aa8e-e507731f2b89 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:03.726677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc219-f4fb-49cc-aa8e-e507731f2b89 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:03.726963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc219-f4fb-49cc-aa8e-e507731f2b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:03.747660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-892fc219-f4fb-49cc-aa8e-e507731f2b89 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:03.748964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-892fc219-f4fb-49cc-aa8e-e507731f2b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:03.831659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 548/1081] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:03.857182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2685ff9-143f-4450-890e-524066363c0e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:03.987680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2685ff9-143f-4450-890e-524066363c0e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:04.024976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe638a-1383-4fe1-958b-0450237e250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:04.025899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe638a-1383-4fe1-958b-0450237e250b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:04.026359 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe638a-1383-4fe1-958b-0450237e250b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:04.026797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe638a-1383-4fe1-958b-0450237e250b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:04.062994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:04.099103 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe638a-1383-4fe1-958b-0450237e250b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:04.100635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe638a-1383-4fe1-958b-0450237e250b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:04.215023 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 534/1082] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:01:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:01:04.222883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fc219-f4fb-49cc-aa8e-e507731f2b89 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:04.327483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fc219-f4fb-49cc-aa8e-e507731f2b89 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:04.328954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:04.364238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54281354-10d2-4c29-b251-f86ae6fb297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:04.365671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54281354-10d2-4c29-b251-f86ae6fb297b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:04.365957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54281354-10d2-4c29-b251-f86ae6fb297b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:04.366256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54281354-10d2-4c29-b251-f86ae6fb297b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:04.376751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54281354-10d2-4c29-b251-f86ae6fb297b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:04.378224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54281354-10d2-4c29-b251-f86ae6fb297b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-54281354-10d2-4c29-b251-f86ae6fb297b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:01:04.396138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:04.397122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:04.398029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:01:04.398029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:01:04.398029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:01:04.398029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:04.398029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 549/1083] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:04.404265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe638a-1383-4fe1-958b-0450237e250b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:04.469964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:04.509015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe638a-1383-4fe1-958b-0450237e250b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:04.552736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef160d76-d892-42b4-b06e-f78e1d096e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:04.553379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160d76-d892-42b4-b06e-f78e1d096e8b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:04.554000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160d76-d892-42b4-b06e-f78e1d096e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:04.554109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef160d76-d892-42b4-b06e-f78e1d096e8b None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:04.554799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef160d76-d892-42b4-b06e-f78e1d096e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:04.555110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef160d76-d892-42b4-b06e-f78e1d096e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:04.556504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef160d76-d892-42b4-b06e-f78e1d096e8b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:04.582264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 535/1084] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:04.908579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb383752-da55-492a-a0f4-c2001d688796 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:04.909109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb383752-da55-492a-a0f4-c2001d688796 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:04.909109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb383752-da55-492a-a0f4-c2001d688796 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:04.910536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 550/1085] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:04.916441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909009cd-6f6f-42bb-b48c-8d33c6360ec3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:04.916878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909009cd-6f6f-42bb-b48c-8d33c6360ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:04.917005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909009cd-6f6f-42bb-b48c-8d33c6360ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:04.933510 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-909009cd-6f6f-42bb-b48c-8d33c6360ec3 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:04.934725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-909009cd-6f6f-42bb-b48c-8d33c6360ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:05.001077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 536/1086] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:05.025694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb383752-da55-492a-a0f4-c2001d688796 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:05.127201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb383752-da55-492a-a0f4-c2001d688796 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:05.160628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549dd22-49e9-47c9-86ad-0819c7fb9969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:05.161906 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549dd22-49e9-47c9-86ad-0819c7fb9969 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:05.162218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549dd22-49e9-47c9-86ad-0819c7fb9969 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:05.162503 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549dd22-49e9-47c9-86ad-0819c7fb9969 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:05.172593 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549dd22-49e9-47c9-86ad-0819c7fb9969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-5549dd22-49e9-47c9-86ad-0819c7fb9969 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:01:05.181523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:05.182611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:05.183643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 551/1087] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Jul 11 14:01:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:05.188680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909009cd-6f6f-42bb-b48c-8d33c6360ec3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:05.249930 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:05.294891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909009cd-6f6f-42bb-b48c-8d33c6360ec3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:05.329739 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b99e3-916b-47d0-9c87-9b92225d5b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:05.330432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b99e3-916b-47d0-9c87-9b92225d5b0c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:05.330713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b99e3-916b-47d0-9c87-9b92225d5b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:05.330986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b99e3-916b-47d0-9c87-9b92225d5b0c None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:05.331723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b99e3-916b-47d0-9c87-9b92225d5b0c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:05.332022 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b99e3-916b-47d0-9c87-9b92225d5b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:05.333510 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b99e3-916b-47d0-9c87-9b92225d5b0c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:05.341808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 537/1088] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Jul 11 14:01:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:05.347387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549dd22-49e9-47c9-86ad-0819c7fb9969 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:05.365681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:05.450299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549dd22-49e9-47c9-86ad-0819c7fb9969 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:05.484084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f51dc7-7f07-4512-a89d-6cb324343485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:05.484875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51dc7-7f07-4512-a89d-6cb324343485 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:05.485161 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51dc7-7f07-4512-a89d-6cb324343485 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:05.485437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51dc7-7f07-4512-a89d-6cb324343485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:05.496207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f51dc7-7f07-4512-a89d-6cb324343485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:05.497667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f51dc7-7f07-4512-a89d-6cb324343485 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-36f51dc7-7f07-4512-a89d-6cb324343485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:01:05.515020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:05.515954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:05.516854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:01:05.516854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:01:05.516854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:01:05.516854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:05.518320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 552/1089] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:05.522745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b99e3-916b-47d0-9c87-9b92225d5b0c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:05.588169 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dec8a-5342-44af-afce-4d43b1f2300e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:05.588461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dec8a-5342-44af-afce-4d43b1f2300e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:05.588746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dec8a-5342-44af-afce-4d43b1f2300e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:05.590126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 553/1090] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:01:05.594954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03767a87-c78d-4419-8673-b2a27318b328 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:05.595246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03767a87-c78d-4419-8673-b2a27318b328 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:05.595527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03767a87-c78d-4419-8673-b2a27318b328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:05.612883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-03767a87-c78d-4419-8673-b2a27318b328 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:05.614079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-03767a87-c78d-4419-8673-b2a27318b328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:05.622826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b99e3-916b-47d0-9c87-9b92225d5b0c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:05.639445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:05.657560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3a60-bf55-41e2-8325-e0986bef1c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:05.658254 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3a60-bf55-41e2-8325-e0986bef1c89 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:05.658536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3a60-bf55-41e2-8325-e0986bef1c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:05.658813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af3a60-bf55-41e2-8325-e0986bef1c89 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:05.659528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af3a60-bf55-41e2-8325-e0986bef1c89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:05.659827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af3a60-bf55-41e2-8325-e0986bef1c89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:05.661198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af3a60-bf55-41e2-8325-e0986bef1c89 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:05.673735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 538/1091] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:05.675410 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:05.679925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3a60-bf55-41e2-8325-e0986bef1c89 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:05.683243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 554/1092] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:01:05.706498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03767a87-c78d-4419-8673-b2a27318b328 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:05.780166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af3a60-bf55-41e2-8325-e0986bef1c89 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:05.807273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03767a87-c78d-4419-8673-b2a27318b328 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:05.814760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76206c68-430d-432e-b847-f6dbe22492b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:05.815550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76206c68-430d-432e-b847-f6dbe22492b3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:05.815830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76206c68-430d-432e-b847-f6dbe22492b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:05.816103 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76206c68-430d-432e-b847-f6dbe22492b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:05.823907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76206c68-430d-432e-b847-f6dbe22492b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:05.825346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76206c68-430d-432e-b847-f6dbe22492b3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-76206c68-430d-432e-b847-f6dbe22492b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:01:05.840169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:05.841171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:05.842132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:05.842132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:05.842132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:01:05.842132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:01:05.842132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:01:05.842132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:01:05.842132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:01:05.842132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:01:05.842132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 11 14:01:05.842132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:01:05.842132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 539/1093] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Jul 11 14:01:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:01:05.842767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3aeb6-679a-479b-a48c-bdb88ca4e098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:05.842767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3aeb6-679a-479b-a48c-bdb88ca4e098 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:05.842944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3aeb6-679a-479b-a48c-bdb88ca4e098 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:05.843177 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3aeb6-679a-479b-a48c-bdb88ca4e098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:05.846936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76206c68-430d-432e-b847-f6dbe22492b3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:05.853943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3aeb6-679a-479b-a48c-bdb88ca4e098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-80c3aeb6-679a-479b-a48c-bdb88ca4e098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:01:05.861678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:05.862682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:05.863537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 555/1094] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:01:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:01:05.868756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3aeb6-679a-479b-a48c-bdb88ca4e098 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:05.890316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:05.926631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:05.953529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76206c68-430d-432e-b847-f6dbe22492b3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:05.971753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3aeb6-679a-479b-a48c-bdb88ca4e098 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:05.989562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938048e-7f3b-40a2-b7a4-898958b7a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:05.990542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938048e-7f3b-40a2-b7a4-898958b7a826 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:05.990825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938048e-7f3b-40a2-b7a4-898958b7a826 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:05.991102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938048e-7f3b-40a2-b7a4-898958b7a826 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:05.991950 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938048e-7f3b-40a2-b7a4-898958b7a826 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:05.992256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938048e-7f3b-40a2-b7a4-898958b7a826 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:05.993688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938048e-7f3b-40a2-b7a4-898958b7a826 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:06.009031 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08748a33-f4e9-4c97-bee2-7b82a3265c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:06.009734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08748a33-f4e9-4c97-bee2-7b82a3265c0a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:06.010017 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08748a33-f4e9-4c97-bee2-7b82a3265c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:06.010421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08748a33-f4e9-4c97-bee2-7b82a3265c0a None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:06.011294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08748a33-f4e9-4c97-bee2-7b82a3265c0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:06.011772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08748a33-f4e9-4c97-bee2-7b82a3265c0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:06.013126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08748a33-f4e9-4c97-bee2-7b82a3265c0a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:06.014017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 540/1095] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Jul 11 14:01:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:01:06.020194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938048e-7f3b-40a2-b7a4-898958b7a826 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:06.026203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 556/1096] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:01:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:01:06.028951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08748a33-f4e9-4c97-bee2-7b82a3265c0a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:06.113667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:06.120750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938048e-7f3b-40a2-b7a4-898958b7a826 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:06.132435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08748a33-f4e9-4c97-bee2-7b82a3265c0a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:06.150313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:06.156274 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a9409-ff5b-4dc3-b7f5-ca281db9da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:06.156938 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a9409-ff5b-4dc3-b7f5-ca281db9da05 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:06.157221 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a9409-ff5b-4dc3-b7f5-ca281db9da05 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:06.157509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a9409-ff5b-4dc3-b7f5-ca281db9da05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:06.169224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457bec3-67a6-45c5-9641-fe19f3613a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:06.170109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457bec3-67a6-45c5-9641-fe19f3613a73 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:06.170426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457bec3-67a6-45c5-9641-fe19f3613a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:06.170706 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457bec3-67a6-45c5-9641-fe19f3613a73 None admin] PATH_INFO: `/v3/users/8929ead00dfc469e88ed1a37450fbaee` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:06.171916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457bec3-67a6-45c5-9641-fe19f3613a73 None admin] RBAC: Authorizing `identity:get_user(user_id=8929ead00dfc469e88ed1a37450fbaee)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:06.173353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7457bec3-67a6-45c5-9641-fe19f3613a73 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:06.175055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 557/1097] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:06 2022] GET /identity/v3/users/8929ead00dfc469e88ed1a37450fbaee => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:01:06.180960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457bec3-67a6-45c5-9641-fe19f3613a73 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:06.230236 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a9409-ff5b-4dc3-b7f5-ca281db9da05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:06.231642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a9409-ff5b-4dc3-b7f5-ca281db9da05 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:06.290863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457bec3-67a6-45c5-9641-fe19f3613a73 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:06.324613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9facf-2cf1-49ff-9421-6cc126963845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:06.325277 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9facf-2cf1-49ff-9421-6cc126963845 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:06.325562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9facf-2cf1-49ff-9421-6cc126963845 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:06.325852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9facf-2cf1-49ff-9421-6cc126963845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:06.326015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:06.332898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 541/1098] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:01:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:01:06.339182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a9409-ff5b-4dc3-b7f5-ca281db9da05 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:06.380811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:06.395198 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9facf-2cf1-49ff-9421-6cc126963845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:06.397301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9facf-2cf1-49ff-9421-6cc126963845 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:06.436917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a9409-ff5b-4dc3-b7f5-ca281db9da05 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:06.470683 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cceda-d74b-4c6d-a3d4-6e1b39eb0019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:06.471461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cceda-d74b-4c6d-a3d4-6e1b39eb0019 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:06.471742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cceda-d74b-4c6d-a3d4-6e1b39eb0019 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:06.472015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cceda-d74b-4c6d-a3d4-6e1b39eb0019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:06.482694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cceda-d74b-4c6d-a3d4-6e1b39eb0019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:06.484078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cceda-d74b-4c6d-a3d4-6e1b39eb0019 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:06.497160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 558/1099] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:01:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:01:06.503047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9facf-2cf1-49ff-9421-6cc126963845 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-189cceda-d74b-4c6d-a3d4-6e1b39eb0019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:01:06.503185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:06.504238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:06.505791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:01:06.505791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:01:06.505791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:01:06.505791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:01:06.505791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 542/1100] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:01:06.510609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cceda-d74b-4c6d-a3d4-6e1b39eb0019 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:06.561891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:06.592075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:06.608413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9facf-2cf1-49ff-9421-6cc126963845 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:06.617728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cceda-d74b-4c6d-a3d4-6e1b39eb0019 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:06.646839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae59d7-b54d-444d-9407-4f760a6f9ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:06.647714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae59d7-b54d-444d-9407-4f760a6f9ead None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:06.648000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae59d7-b54d-444d-9407-4f760a6f9ead None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:06.648287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae59d7-b54d-444d-9407-4f760a6f9ead None admin] PATH_INFO: `/v3/projects/b6ab499e09344f6e9165fb6cff1eec42` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:06.649491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae59d7-b54d-444d-9407-4f760a6f9ead None admin] RBAC: Authorizing `identity:get_project(project_id=b6ab499e09344f6e9165fb6cff1eec42)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:06.651009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae59d7-b54d-444d-9407-4f760a6f9ead None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:06.652698 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 559/1101] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:06 2022] GET /identity/v3/projects/b6ab499e09344f6e9165fb6cff1eec42 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:01:06.657980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a12f2-f0c9-4dd7-85f6-c7b6385bb023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:06.657980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a12f2-f0c9-4dd7-85f6-c7b6385bb023 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:06.657980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a12f2-f0c9-4dd7-85f6-c7b6385bb023 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:06.657980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a12f2-f0c9-4dd7-85f6-c7b6385bb023 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:06.658406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a12f2-f0c9-4dd7-85f6-c7b6385bb023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:06.658406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a12f2-f0c9-4dd7-85f6-c7b6385bb023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:06.658406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a12f2-f0c9-4dd7-85f6-c7b6385bb023 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:06.658674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae59d7-b54d-444d-9407-4f760a6f9ead None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:06.672992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 543/1102] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:01:06.674058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a12f2-f0c9-4dd7-85f6-c7b6385bb023 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:06.758320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae59d7-b54d-444d-9407-4f760a6f9ead None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:06.777740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a12f2-f0c9-4dd7-85f6-c7b6385bb023 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:06.786735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:06.793015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc4884-574e-48db-b372-783824341a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:06.793679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc4884-574e-48db-b372-783824341a5d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:06.793968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc4884-574e-48db-b372-783824341a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:06.794284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc4884-574e-48db-b372-783824341a5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:06.795131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc4884-574e-48db-b372-783824341a5d None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=b6ab499e09344f6e9165fb6cff1eec42, user.id=8929ead00dfc469e88ed1a37450fbaee) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:06.795450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc4884-574e-48db-b372-783824341a5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:06.796878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc4884-574e-48db-b372-783824341a5d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:06.803701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 560/1103] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:01:06 2022] GET /identity/v3/role_assignments?user.id=8929ead00dfc469e88ed1a37450fbaee&scope.project.id=b6ab499e09344f6e9165fb6cff1eec42&role.id=57f1335a97b5490cb0853894c2faf62c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:01:06.812886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f347f17-2593-497d-bebb-80afb5fa57d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:06.813705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f347f17-2593-497d-bebb-80afb5fa57d0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:06.813985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f347f17-2593-497d-bebb-80afb5fa57d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:06.814291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f347f17-2593-497d-bebb-80afb5fa57d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:06.822956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f347f17-2593-497d-bebb-80afb5fa57d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:06.824437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f347f17-2593-497d-bebb-80afb5fa57d0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1f347f17-2593-497d-bebb-80afb5fa57d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:01:06.840802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:06.841787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:06.842777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:01:06.842777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:01:06.842777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:01:06.842777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:01:06.842777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:01:06.842777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:01:06.842777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:01:06.842777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:01:06.842777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 544/1104] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:01:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:06.848156 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc4884-574e-48db-b372-783824341a5d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:06.869675 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:06.957774 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc4884-574e-48db-b372-783824341a5d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:06.993193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb235da-1cf9-484c-8db0-a914744c8dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:06.993904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb235da-1cf9-484c-8db0-a914744c8dcf None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:06.994267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb235da-1cf9-484c-8db0-a914744c8dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:06.994515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb235da-1cf9-484c-8db0-a914744c8dcf None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:06.995327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb235da-1cf9-484c-8db0-a914744c8dcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:06.995645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb235da-1cf9-484c-8db0-a914744c8dcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:06.997092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb235da-1cf9-484c-8db0-a914744c8dcf None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:07.011691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 561/1105] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:01:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:07.017807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f347f17-2593-497d-bebb-80afb5fa57d0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:07.120033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f347f17-2593-497d-bebb-80afb5fa57d0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:07.154946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb518cdd-33ce-43e3-af5c-a4fb775899b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:07.155604 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb518cdd-33ce-43e3-af5c-a4fb775899b3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:07.155891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb518cdd-33ce-43e3-af5c-a4fb775899b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:07.156173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb518cdd-33ce-43e3-af5c-a4fb775899b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:07.157008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb518cdd-33ce-43e3-af5c-a4fb775899b3 None admin] RBAC: Adding query filter params (role.id=b4157aafaef74a9fbbe56bae19de8b02, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=38a31386700941c9b103720a64bac405) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:07.157328 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb518cdd-33ce-43e3-af5c-a4fb775899b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:07.158885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb518cdd-33ce-43e3-af5c-a4fb775899b3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:07.165175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 545/1106] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:01:07 2022] GET /identity/v3/role_assignments?user.id=38a31386700941c9b103720a64bac405&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=b4157aafaef74a9fbbe56bae19de8b02 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:08.901714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9f94-7a6f-4573-9da7-e7a95c3ff0f3 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:08.902380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9f94-7a6f-4573-9da7-e7a95c3ff0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:08.902380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9f94-7a6f-4573-9da7-e7a95c3ff0f3 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:08.903722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 562/1107] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:08.908878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bf915-572e-4589-ad2c-2a1166ae9723 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:08.909286 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bf915-572e-4589-ad2c-2a1166ae9723 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:08.909434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bf915-572e-4589-ad2c-2a1166ae9723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:08.926035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4c5bf915-572e-4589-ad2c-2a1166ae9723 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:08.927560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4c5bf915-572e-4589-ad2c-2a1166ae9723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:08.953093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:08.994947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 546/1108] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:09.020326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be9f94-7a6f-4573-9da7-e7a95c3ff0f3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:09.101349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:09.124625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be9f94-7a6f-4573-9da7-e7a95c3ff0f3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:09.158020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497ebba-2d1b-4878-ade5-30a996848e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:09.158761 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497ebba-2d1b-4878-ade5-30a996848e92 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:09.159046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497ebba-2d1b-4878-ade5-30a996848e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:09.159325 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497ebba-2d1b-4878-ade5-30a996848e92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:09.160476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497ebba-2d1b-4878-ade5-30a996848e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:09.162039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497ebba-2d1b-4878-ade5-30a996848e92 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:09.163688 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 563/1109] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:01:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:09.169437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bf915-572e-4589-ad2c-2a1166ae9723 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:09.268554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bf915-572e-4589-ad2c-2a1166ae9723 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:09.301475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521ac8d-3881-4e16-af6a-62f487fbac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:09.302918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521ac8d-3881-4e16-af6a-62f487fbac6d None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:09.303200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521ac8d-3881-4e16-af6a-62f487fbac6d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:09.303478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521ac8d-3881-4e16-af6a-62f487fbac6d None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:09.304201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521ac8d-3881-4e16-af6a-62f487fbac6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:09.305643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521ac8d-3881-4e16-af6a-62f487fbac6d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:09.325325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 547/1110] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 14:01:09 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:01:11.412467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bea2e7-65ca-4744-a396-602841f57c3e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:11.413014 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bea2e7-65ca-4744-a396-602841f57c3e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:11.413112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bea2e7-65ca-4744-a396-602841f57c3e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:11.414592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 564/1111] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:11.419794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa9fc-e1cf-483d-a1e3-f5241f421766 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:11.420202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa9fc-e1cf-483d-a1e3-f5241f421766 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:11.420363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa9fc-e1cf-483d-a1e3-f5241f421766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:11.436824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-67ffa9fc-e1cf-483d-a1e3-f5241f421766 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:11.438018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-67ffa9fc-e1cf-483d-a1e3-f5241f421766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:11.451061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:11.504908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 548/1112] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:11.528908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bea2e7-65ca-4744-a396-602841f57c3e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:11.643137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bea2e7-65ca-4744-a396-602841f57c3e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:11.676889 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c529da-6e01-42d5-aa1d-5df42748ce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:11.677740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c529da-6e01-42d5-aa1d-5df42748ce8f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:11.678022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c529da-6e01-42d5-aa1d-5df42748ce8f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:11.678329 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c529da-6e01-42d5-aa1d-5df42748ce8f None admin] PATH_INFO: `/v3/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:11.679791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c529da-6e01-42d5-aa1d-5df42748ce8f None admin] RBAC: Authorizing `identity:get_role(role_id=a9fb1d2d70d24a29a0fad5800c9ea0f7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:11.681147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c529da-6e01-42d5-aa1d-5df42748ce8f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:11.682553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 565/1113] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:11 2022] GET /identity/v3/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:11.688364 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffa9fc-e1cf-483d-a1e3-f5241f421766 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:11.784975 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffa9fc-e1cf-483d-a1e3-f5241f421766 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:11.816695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b6154-5b81-4ff4-8688-d4840f130f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:11.818108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6154-5b81-4ff4-8688-d4840f130f25 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:11.818418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6154-5b81-4ff4-8688-d4840f130f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:11.818687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b6154-5b81-4ff4-8688-d4840f130f25 None admin] PATH_INFO: `/v3/users/cbefca5770bf46e39679e078df983995` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:11.831165 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b6154-5b81-4ff4-8688-d4840f130f25 None admin] RBAC: Authorizing `identity:get_user(user_id=cbefca5770bf46e39679e078df983995)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:11.832604 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b6154-5b81-4ff4-8688-d4840f130f25 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:11.835035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 549/1114] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:11 2022] GET /identity/v3/users/cbefca5770bf46e39679e078df983995 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:11.840767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c529da-6e01-42d5-aa1d-5df42748ce8f None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:11.856701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:11.942761 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c529da-6e01-42d5-aa1d-5df42748ce8f None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:11.975436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c111a8-6eef-44d3-a23f-c570610ebdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:11.976086 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c111a8-6eef-44d3-a23f-c570610ebdec None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:11.976374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c111a8-6eef-44d3-a23f-c570610ebdec None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:11.976654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c111a8-6eef-44d3-a23f-c570610ebdec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:12.044747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c111a8-6eef-44d3-a23f-c570610ebdec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:12.046119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c111a8-6eef-44d3-a23f-c570610ebdec None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:12.060221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:12.145886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 566/1115] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:01:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:01:12.151958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b6154-5b81-4ff4-8688-d4840f130f25 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:12.160598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:12.257940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b6154-5b81-4ff4-8688-d4840f130f25 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:12.290494 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7481959-6010-4ecb-bf9a-37275e97d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:12.291342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7481959-6010-4ecb-bf9a-37275e97d399 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:12.291621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7481959-6010-4ecb-bf9a-37275e97d399 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:12.291892 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7481959-6010-4ecb-bf9a-37275e97d399 None admin] PATH_INFO: `/v3/projects/b6ab499e09344f6e9165fb6cff1eec42` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:12.293059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7481959-6010-4ecb-bf9a-37275e97d399 None admin] RBAC: Authorizing `identity:get_project(project_id=b6ab499e09344f6e9165fb6cff1eec42)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:12.294510 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7481959-6010-4ecb-bf9a-37275e97d399 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:12.296238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 550/1116] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:12 2022] GET /identity/v3/projects/b6ab499e09344f6e9165fb6cff1eec42 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:12.303172 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c111a8-6eef-44d3-a23f-c570610ebdec None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:12.402247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c111a8-6eef-44d3-a23f-c570610ebdec None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:12.415704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:12.436249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42f7d7-af57-4f1d-a38d-7508dd9a9da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:12.436905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42f7d7-af57-4f1d-a38d-7508dd9a9da9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:12.437191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42f7d7-af57-4f1d-a38d-7508dd9a9da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:12.437468 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42f7d7-af57-4f1d-a38d-7508dd9a9da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:12.438338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42f7d7-af57-4f1d-a38d-7508dd9a9da9 None admin] RBAC: Adding query filter params (role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7, scope.project.id=b6ab499e09344f6e9165fb6cff1eec42, user.id=cbefca5770bf46e39679e078df983995) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:12.438652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42f7d7-af57-4f1d-a38d-7508dd9a9da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:12.440084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42f7d7-af57-4f1d-a38d-7508dd9a9da9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:12.446259 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 567/1117] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:01:12 2022] GET /identity/v3/role_assignments?user.id=cbefca5770bf46e39679e078df983995&scope.project.id=b6ab499e09344f6e9165fb6cff1eec42&role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:14.459057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927206f-4d5e-443c-9a56-5ccb0c657e63 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:14.459637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927206f-4d5e-443c-9a56-5ccb0c657e63 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:14.459637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927206f-4d5e-443c-9a56-5ccb0c657e63 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:14.460966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 551/1118] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:14.466431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d450b53-76a6-4839-9c41-90515e707e14 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:14.466829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d450b53-76a6-4839-9c41-90515e707e14 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:14.466951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d450b53-76a6-4839-9c41-90515e707e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:14.483958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-8d450b53-76a6-4839-9c41-90515e707e14 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:14.485196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8d450b53-76a6-4839-9c41-90515e707e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:14.551818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 568/1119] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:14.574002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927206f-4d5e-443c-9a56-5ccb0c657e63 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:14.653148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:14.679685 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927206f-4d5e-443c-9a56-5ccb0c657e63 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:14.712788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5c9c0-848f-4904-b24a-64fed05da600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:14.713647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5c9c0-848f-4904-b24a-64fed05da600 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:14.713926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5c9c0-848f-4904-b24a-64fed05da600 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:14.714368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5c9c0-848f-4904-b24a-64fed05da600 None admin] PATH_INFO: `/v3/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:14.715853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5c9c0-848f-4904-b24a-64fed05da600 None admin] RBAC: Authorizing `identity:get_role(role_id=a9fb1d2d70d24a29a0fad5800c9ea0f7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:14.717273 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5c9c0-848f-4904-b24a-64fed05da600 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:14.718622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 552/1120] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:14 2022] GET /identity/v3/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:14.724660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d450b53-76a6-4839-9c41-90515e707e14 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:14.822265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d450b53-76a6-4839-9c41-90515e707e14 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:14.831846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:14.856784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abf75e-690d-4ff5-a6f7-38df4175ff9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:14.857648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abf75e-690d-4ff5-a6f7-38df4175ff9a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:14.857930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abf75e-690d-4ff5-a6f7-38df4175ff9a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:14.858229 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abf75e-690d-4ff5-a6f7-38df4175ff9a None admin] PATH_INFO: `/v3/users/cbefca5770bf46e39679e078df983995` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:14.859397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abf75e-690d-4ff5-a6f7-38df4175ff9a None admin] RBAC: Authorizing `identity:get_user(user_id=cbefca5770bf46e39679e078df983995)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:14.860810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abf75e-690d-4ff5-a6f7-38df4175ff9a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:14.862469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 569/1121] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:14 2022] GET /identity/v3/users/cbefca5770bf46e39679e078df983995 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:14.868983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5c9c0-848f-4904-b24a-64fed05da600 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:14.965438 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5c9c0-848f-4904-b24a-64fed05da600 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:14.999079 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dad4b-bfb1-4dcb-af10-c83027fd710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:14.999871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dad4b-bfb1-4dcb-af10-c83027fd710d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:15.000154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dad4b-bfb1-4dcb-af10-c83027fd710d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:15.000430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dad4b-bfb1-4dcb-af10-c83027fd710d None admin] PATH_INFO: `/v3/projects/b6ab499e09344f6e9165fb6cff1eec42` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:15.001613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dad4b-bfb1-4dcb-af10-c83027fd710d None admin] RBAC: Authorizing `identity:get_project(project_id=b6ab499e09344f6e9165fb6cff1eec42)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:15.003078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dad4b-bfb1-4dcb-af10-c83027fd710d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:15.004815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 553/1122] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:14 2022] GET /identity/v3/projects/b6ab499e09344f6e9165fb6cff1eec42 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:15.010947 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abf75e-690d-4ff5-a6f7-38df4175ff9a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:15.108109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abf75e-690d-4ff5-a6f7-38df4175ff9a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:15.141422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c74fa7-5afa-4d01-9d2d-cc745d2275aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:15.142333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c74fa7-5afa-4d01-9d2d-cc745d2275aa None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:15.142623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c74fa7-5afa-4d01-9d2d-cc745d2275aa None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:15.142899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c74fa7-5afa-4d01-9d2d-cc745d2275aa None admin] PATH_INFO: `/v3/projects/b6ab499e09344f6e9165fb6cff1eec42/users/cbefca5770bf46e39679e078df983995/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:15.145844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c74fa7-5afa-4d01-9d2d-cc745d2275aa None admin] RBAC: Authorizing `identity:create_grant(project_id=b6ab499e09344f6e9165fb6cff1eec42, user_id=cbefca5770bf46e39679e078df983995, role_id=a9fb1d2d70d24a29a0fad5800c9ea0f7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:15.147305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c74fa7-5afa-4d01-9d2d-cc745d2275aa None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:15.161540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 570/1123] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:01:15 2022] PUT /identity/v3/projects/b6ab499e09344f6e9165fb6cff1eec42/users/cbefca5770bf46e39679e078df983995/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:01:17.165808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395eda3-e5fd-46f7-9e30-c28cea32e0f7 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:17.166402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395eda3-e5fd-46f7-9e30-c28cea32e0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:17.166402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395eda3-e5fd-46f7-9e30-c28cea32e0f7 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:17.167766 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 554/1124] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:17.172821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733b6a4-533e-4684-9dd3-97ad687cf848 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:17.173255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733b6a4-533e-4684-9dd3-97ad687cf848 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:17.173473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733b6a4-533e-4684-9dd3-97ad687cf848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:17.190126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-6733b6a4-533e-4684-9dd3-97ad687cf848 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:17.191366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6733b6a4-533e-4684-9dd3-97ad687cf848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:17.221237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:17.272190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 571/1125] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:17.297570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395eda3-e5fd-46f7-9e30-c28cea32e0f7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:17.310146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:17.402574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395eda3-e5fd-46f7-9e30-c28cea32e0f7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:17.436173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993e88b-5959-4917-a893-d6602f402f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:17.436947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993e88b-5959-4917-a893-d6602f402f92 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:17.437232 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993e88b-5959-4917-a893-d6602f402f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:17.437509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993e88b-5959-4917-a893-d6602f402f92 None admin] PATH_INFO: `/v3/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:17.439006 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993e88b-5959-4917-a893-d6602f402f92 None admin] RBAC: Authorizing `identity:get_role(role_id=a9fb1d2d70d24a29a0fad5800c9ea0f7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:17.440383 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993e88b-5959-4917-a893-d6602f402f92 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:17.441749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 555/1126] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:17 2022] GET /identity/v3/roles/a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:17.448526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733b6a4-533e-4684-9dd3-97ad687cf848 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:17.546004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733b6a4-533e-4684-9dd3-97ad687cf848 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:17.579614 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ce773-5e95-4041-a209-dfe4edb4891e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:17.580476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ce773-5e95-4041-a209-dfe4edb4891e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:17.580758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ce773-5e95-4041-a209-dfe4edb4891e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:17.581039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ce773-5e95-4041-a209-dfe4edb4891e None admin] PATH_INFO: `/v3/users/cbefca5770bf46e39679e078df983995` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:17.582236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ce773-5e95-4041-a209-dfe4edb4891e None admin] RBAC: Authorizing `identity:get_user(user_id=cbefca5770bf46e39679e078df983995)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:17.583751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ce773-5e95-4041-a209-dfe4edb4891e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:17.585372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 572/1127] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:17 2022] GET /identity/v3/users/cbefca5770bf46e39679e078df983995 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:17.591217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993e88b-5959-4917-a893-d6602f402f92 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:17.667603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:17.689142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993e88b-5959-4917-a893-d6602f402f92 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:17.723233 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903a348-d0be-4f50-a28c-fed44775d6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:17.723884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903a348-d0be-4f50-a28c-fed44775d6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:17.724173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903a348-d0be-4f50-a28c-fed44775d6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:17.724457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903a348-d0be-4f50-a28c-fed44775d6a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:17.791152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903a348-d0be-4f50-a28c-fed44775d6a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:17.792594 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903a348-d0be-4f50-a28c-fed44775d6a4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:17.868042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:17.890078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 556/1128] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:01:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:01:17.896243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ce773-5e95-4041-a209-dfe4edb4891e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:17.929954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:17.994499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ce773-5e95-4041-a209-dfe4edb4891e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:18.027026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe7b83-3c8c-4271-81d4-6a9f6d5bd565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:18.027884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe7b83-3c8c-4271-81d4-6a9f6d5bd565 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:18.028189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe7b83-3c8c-4271-81d4-6a9f6d5bd565 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:18.028447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe7b83-3c8c-4271-81d4-6a9f6d5bd565 None admin] PATH_INFO: `/v3/projects/b6ab499e09344f6e9165fb6cff1eec42` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:18.029621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe7b83-3c8c-4271-81d4-6a9f6d5bd565 None admin] RBAC: Authorizing `identity:get_project(project_id=b6ab499e09344f6e9165fb6cff1eec42)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:18.031074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe7b83-3c8c-4271-81d4-6a9f6d5bd565 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:18.032786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 573/1129] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:17 2022] GET /identity/v3/projects/b6ab499e09344f6e9165fb6cff1eec42 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:18.039507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903a348-d0be-4f50-a28c-fed44775d6a4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:18.136867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903a348-d0be-4f50-a28c-fed44775d6a4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:18.170333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e470d-2030-4afc-b6af-c9900c82d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:18.170984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e470d-2030-4afc-b6af-c9900c82d7dc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:18.171262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e470d-2030-4afc-b6af-c9900c82d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:18.171534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e470d-2030-4afc-b6af-c9900c82d7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:18.172361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e470d-2030-4afc-b6af-c9900c82d7dc None admin] RBAC: Adding query filter params (role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7, scope.project.id=b6ab499e09344f6e9165fb6cff1eec42, user.id=cbefca5770bf46e39679e078df983995) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:18.172671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e470d-2030-4afc-b6af-c9900c82d7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:18.174101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e470d-2030-4afc-b6af-c9900c82d7dc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:18.179926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 557/1130] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:01:18 2022] GET /identity/v3/role_assignments?user.id=cbefca5770bf46e39679e078df983995&scope.project.id=b6ab499e09344f6e9165fb6cff1eec42&role.id=a9fb1d2d70d24a29a0fad5800c9ea0f7 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:20.261672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499a2db-ddf2-43d0-8abd-5e5bb683835f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:20.262237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499a2db-ddf2-43d0-8abd-5e5bb683835f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:20.262237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499a2db-ddf2-43d0-8abd-5e5bb683835f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:20.263628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 574/1131] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:20.268765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622ade5-c2b9-4c28-90c7-790d76835001 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:20.269175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622ade5-c2b9-4c28-90c7-790d76835001 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:20.269331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622ade5-c2b9-4c28-90c7-790d76835001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:20.286956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b622ade5-c2b9-4c28-90c7-790d76835001 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:20.288154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b622ade5-c2b9-4c28-90c7-790d76835001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:20.323112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:20.355619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 558/1132] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:20.380193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499a2db-ddf2-43d0-8abd-5e5bb683835f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:20.482521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499a2db-ddf2-43d0-8abd-5e5bb683835f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:20.483942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:20.519355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a467603-4de0-4e0c-abd1-f103bddc6dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:20.520946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a467603-4de0-4e0c-abd1-f103bddc6dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:20.521229 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a467603-4de0-4e0c-abd1-f103bddc6dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:20.521508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a467603-4de0-4e0c-abd1-f103bddc6dd5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:20.522715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a467603-4de0-4e0c-abd1-f103bddc6dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:20.524151 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a467603-4de0-4e0c-abd1-f103bddc6dd5 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:20.525788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 575/1133] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:01:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:20.531657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622ade5-c2b9-4c28-90c7-790d76835001 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:20.629497 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622ade5-c2b9-4c28-90c7-790d76835001 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:20.664013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4792c-15f1-4fb7-982b-3c7f7b983e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:20.664674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4792c-15f1-4fb7-982b-3c7f7b983e98 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:20.664963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4792c-15f1-4fb7-982b-3c7f7b983e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:20.665245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4792c-15f1-4fb7-982b-3c7f7b983e98 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:20.665972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4792c-15f1-4fb7-982b-3c7f7b983e98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:20.667444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4792c-15f1-4fb7-982b-3c7f7b983e98 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:20.692328 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 559/1134] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 14:01:20 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:01:22.733416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7496d7e-435c-4690-8550-8e24af212515 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:22.733983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7496d7e-435c-4690-8550-8e24af212515 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:22.733983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7496d7e-435c-4690-8550-8e24af212515 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:22.735393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 576/1135] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:01:22.740765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af333ac6-b159-49de-8652-65d99cd708ef None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:22.741191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af333ac6-b159-49de-8652-65d99cd708ef None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:22.741305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af333ac6-b159-49de-8652-65d99cd708ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:22.758339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-af333ac6-b159-49de-8652-65d99cd708ef None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:22.759517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-af333ac6-b159-49de-8652-65d99cd708ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:22.777099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:22.829354 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 560/1136] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 11 14:01:22.855220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7496d7e-435c-4690-8550-8e24af212515 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:22.957979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7496d7e-435c-4690-8550-8e24af212515 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:22.991852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefefff0-1ad2-4a7f-b7aa-f460a0b82a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:22.992577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefefff0-1ad2-4a7f-b7aa-f460a0b82a45 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:22.992868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefefff0-1ad2-4a7f-b7aa-f460a0b82a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:22.993152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefefff0-1ad2-4a7f-b7aa-f460a0b82a45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:22.994362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefefff0-1ad2-4a7f-b7aa-f460a0b82a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:22.995799 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefefff0-1ad2-4a7f-b7aa-f460a0b82a45 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:22.997423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 577/1137] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:01:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:23.003213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af333ac6-b159-49de-8652-65d99cd708ef None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:23.101205 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af333ac6-b159-49de-8652-65d99cd708ef None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:23.134545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf962039-d62e-40d0-b44c-f499c6ed975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:23.135213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf962039-d62e-40d0-b44c-f499c6ed975f None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:23.135496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf962039-d62e-40d0-b44c-f499c6ed975f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:23.135773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf962039-d62e-40d0-b44c-f499c6ed975f None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:23.136475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf962039-d62e-40d0-b44c-f499c6ed975f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:23.137910 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf962039-d62e-40d0-b44c-f499c6ed975f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:23.161889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 561/1138] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 14:01:23 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:01:25.220034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae4a32-f82d-4bc9-a3b2-9fbedae40c99 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:25.220476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae4a32-f82d-4bc9-a3b2-9fbedae40c99 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:25.220596 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae4a32-f82d-4bc9-a3b2-9fbedae40c99 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:25.221973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 578/1139] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:25.228100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74a9d-bc0c-42c1-965a-7898888b3176 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:25.228527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74a9d-bc0c-42c1-965a-7898888b3176 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:25.228660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74a9d-bc0c-42c1-965a-7898888b3176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:25.245396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-22a74a9d-bc0c-42c1-965a-7898888b3176 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:25.246634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-22a74a9d-bc0c-42c1-965a-7898888b3176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:25.249329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:25.313367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 562/1140] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:25.338307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae4a32-f82d-4bc9-a3b2-9fbedae40c99 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:25.378968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:25.438480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae4a32-f82d-4bc9-a3b2-9fbedae40c99 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:25.472405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b6426-0103-4096-97ef-99035f507d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:25.473122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b6426-0103-4096-97ef-99035f507d54 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:25.473408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b6426-0103-4096-97ef-99035f507d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:25.473691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b6426-0103-4096-97ef-99035f507d54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:25.483928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b6426-0103-4096-97ef-99035f507d54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-269b6426-0103-4096-97ef-99035f507d54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:01:25.491691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:25.492893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:25.494024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 579/1141] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:01:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:25.499163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a74a9d-bc0c-42c1-965a-7898888b3176 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:25.598267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a74a9d-bc0c-42c1-965a-7898888b3176 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:25.631840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4e932-e8c7-407f-944f-4f39b2c116c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:25.632506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4e932-e8c7-407f-944f-4f39b2c116c3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:25.632788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4e932-e8c7-407f-944f-4f39b2c116c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:25.633062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4e932-e8c7-407f-944f-4f39b2c116c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:25.633807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4e932-e8c7-407f-944f-4f39b2c116c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:25.634112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4e932-e8c7-407f-944f-4f39b2c116c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:25.635523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4e932-e8c7-407f-944f-4f39b2c116c3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:25.643587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 563/1142] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:25.649755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b6426-0103-4096-97ef-99035f507d54 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:25.743856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:25.748718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b6426-0103-4096-97ef-99035f507d54 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:25.782504 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ddcb-f8df-40ba-98e9-102246b06061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:25.783379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ddcb-f8df-40ba-98e9-102246b06061 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:25.783668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ddcb-f8df-40ba-98e9-102246b06061 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:25.783949 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ddcb-f8df-40ba-98e9-102246b06061 None admin] PATH_INFO: `/v3/users/1798e7dfe00c4f2eaf8d4f5041e844fe` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:25.796909 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8ddcb-f8df-40ba-98e9-102246b06061 None admin] RBAC: Authorizing `identity:get_user(user_id=1798e7dfe00c4f2eaf8d4f5041e844fe)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:25.798379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8ddcb-f8df-40ba-98e9-102246b06061 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:25.800083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 580/1143] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:25 2022] GET /identity/v3/users/1798e7dfe00c4f2eaf8d4f5041e844fe => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:25.806603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4e932-e8c7-407f-944f-4f39b2c116c3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:25.809470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:25.905795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4e932-e8c7-407f-944f-4f39b2c116c3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:25.938981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108e6f-7c77-4e13-a7f1-dcc04d350b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:25.939634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108e6f-7c77-4e13-a7f1-dcc04d350b20 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:25.939925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108e6f-7c77-4e13-a7f1-dcc04d350b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:25.940207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108e6f-7c77-4e13-a7f1-dcc04d350b20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:26.012943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1108e6f-7c77-4e13-a7f1-dcc04d350b20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:26.014376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1108e6f-7c77-4e13-a7f1-dcc04d350b20 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:26.016491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:26.114587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 564/1144] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:01:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:01:26.120496 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ddcb-f8df-40ba-98e9-102246b06061 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:26.219363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ddcb-f8df-40ba-98e9-102246b06061 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:26.253430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f863ed-664c-444a-8e93-4b1744ceae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:26.254417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f863ed-664c-444a-8e93-4b1744ceae26 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:26.254848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f863ed-664c-444a-8e93-4b1744ceae26 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:26.255160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f863ed-664c-444a-8e93-4b1744ceae26 None admin] PATH_INFO: `/v3/projects/28c0456f601e484e962701770c20dc48` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:26.256357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f863ed-664c-444a-8e93-4b1744ceae26 None admin] RBAC: Authorizing `identity:get_project(project_id=28c0456f601e484e962701770c20dc48)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:26.257792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f863ed-664c-444a-8e93-4b1744ceae26 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:26.259536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 581/1145] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:26 2022] GET /identity/v3/projects/28c0456f601e484e962701770c20dc48 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:26.265708 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108e6f-7c77-4e13-a7f1-dcc04d350b20 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:26.362941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108e6f-7c77-4e13-a7f1-dcc04d350b20 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:26.365229 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:26.404742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb0caa-e21d-47a1-97a7-c01095c3809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:26.405390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb0caa-e21d-47a1-97a7-c01095c3809d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:26.405673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb0caa-e21d-47a1-97a7-c01095c3809d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:26.405948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb0caa-e21d-47a1-97a7-c01095c3809d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:26.406816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb0caa-e21d-47a1-97a7-c01095c3809d None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=28c0456f601e484e962701770c20dc48, user.id=1798e7dfe00c4f2eaf8d4f5041e844fe) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:26.407127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb0caa-e21d-47a1-97a7-c01095c3809d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:26.408555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb0caa-e21d-47a1-97a7-c01095c3809d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:26.414566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 565/1146] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:01:26 2022] GET /identity/v3/role_assignments?user.id=1798e7dfe00c4f2eaf8d4f5041e844fe&scope.project.id=28c0456f601e484e962701770c20dc48&role.id=57f1335a97b5490cb0853894c2faf62c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:28.439723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c8861-ab9c-4dd6-a568-10b77f1051fd None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:28.440251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c8861-ab9c-4dd6-a568-10b77f1051fd None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:28.440373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c8861-ab9c-4dd6-a568-10b77f1051fd None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:28.442398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 582/1147] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:28.448073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d581e6-b11f-4480-9928-41dccc897065 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:28.448496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d581e6-b11f-4480-9928-41dccc897065 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:28.448629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d581e6-b11f-4480-9928-41dccc897065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:28.466062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f7d581e6-b11f-4480-9928-41dccc897065 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:28.467219 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f7d581e6-b11f-4480-9928-41dccc897065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:28.531713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 566/1148] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:28.559029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c8861-ab9c-4dd6-a568-10b77f1051fd None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:28.585680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:28.663085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c8861-ab9c-4dd6-a568-10b77f1051fd None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:28.697425 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52add870-9a45-4125-b7cf-029c123b9cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:28.698414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52add870-9a45-4125-b7cf-029c123b9cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:28.698591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52add870-9a45-4125-b7cf-029c123b9cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:28.699303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52add870-9a45-4125-b7cf-029c123b9cc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:28.715010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52add870-9a45-4125-b7cf-029c123b9cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-52add870-9a45-4125-b7cf-029c123b9cc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:01:28.723380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:28.724455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:28.725478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 583/1149] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:28.730753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d581e6-b11f-4480-9928-41dccc897065 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:28.821886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:28.828101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d581e6-b11f-4480-9928-41dccc897065 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:28.861929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc77a5-8f92-4192-b330-4605cc67c6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:28.862623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc77a5-8f92-4192-b330-4605cc67c6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:28.862907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc77a5-8f92-4192-b330-4605cc67c6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:28.863745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc77a5-8f92-4192-b330-4605cc67c6b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:28.864574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc77a5-8f92-4192-b330-4605cc67c6b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:28.864881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc77a5-8f92-4192-b330-4605cc67c6b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:28.866259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc77a5-8f92-4192-b330-4605cc67c6b7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:28.874103 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 567/1150] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:01:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:28.880687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52add870-9a45-4125-b7cf-029c123b9cc4 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:28.962736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:28.984224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52add870-9a45-4125-b7cf-029c123b9cc4 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:29.017749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064cb43-6e78-4fa2-bf96-913aad2dffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:29.018653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064cb43-6e78-4fa2-bf96-913aad2dffe2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:29.018932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064cb43-6e78-4fa2-bf96-913aad2dffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:29.019208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064cb43-6e78-4fa2-bf96-913aad2dffe2 None admin] PATH_INFO: `/v3/users/1798e7dfe00c4f2eaf8d4f5041e844fe` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:29.020686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064cb43-6e78-4fa2-bf96-913aad2dffe2 None admin] RBAC: Authorizing `identity:get_user(user_id=1798e7dfe00c4f2eaf8d4f5041e844fe)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:29.022123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064cb43-6e78-4fa2-bf96-913aad2dffe2 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:29.023793 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 584/1151] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:28 2022] GET /identity/v3/users/1798e7dfe00c4f2eaf8d4f5041e844fe => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:01:29.029642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc77a5-8f92-4192-b330-4605cc67c6b7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:29.128921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc77a5-8f92-4192-b330-4605cc67c6b7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:29.161772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7066b5-93b4-49e1-b8ee-a0a92abd5bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:29.162647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7066b5-93b4-49e1-b8ee-a0a92abd5bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:29.162931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7066b5-93b4-49e1-b8ee-a0a92abd5bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:29.163207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7066b5-93b4-49e1-b8ee-a0a92abd5bc6 None admin] PATH_INFO: `/v3/projects/28c0456f601e484e962701770c20dc48` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:29.164379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7066b5-93b4-49e1-b8ee-a0a92abd5bc6 None admin] RBAC: Authorizing `identity:get_project(project_id=28c0456f601e484e962701770c20dc48)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:29.165938 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7066b5-93b4-49e1-b8ee-a0a92abd5bc6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:29.167663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 568/1152] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:29 2022] GET /identity/v3/projects/28c0456f601e484e962701770c20dc48 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:29.173573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064cb43-6e78-4fa2-bf96-913aad2dffe2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:29.272040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064cb43-6e78-4fa2-bf96-913aad2dffe2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:29.304663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf21a41-a1c9-4a82-9274-e1217bf32726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:29.305546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf21a41-a1c9-4a82-9274-e1217bf32726 None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:29.305825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf21a41-a1c9-4a82-9274-e1217bf32726 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:29.306097 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf21a41-a1c9-4a82-9274-e1217bf32726 None admin] PATH_INFO: `/v3/projects/28c0456f601e484e962701770c20dc48/users/1798e7dfe00c4f2eaf8d4f5041e844fe/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:29.308078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf21a41-a1c9-4a82-9274-e1217bf32726 None admin] RBAC: Authorizing `identity:create_grant(project_id=28c0456f601e484e962701770c20dc48, user_id=1798e7dfe00c4f2eaf8d4f5041e844fe, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:29.309495 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf21a41-a1c9-4a82-9274-e1217bf32726 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:29.322122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 585/1153] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:01:29 2022] PUT /identity/v3/projects/28c0456f601e484e962701770c20dc48/users/1798e7dfe00c4f2eaf8d4f5041e844fe/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:01:31.315161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565d804-102d-4f02-8326-4def47dfa071 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:31.315687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565d804-102d-4f02-8326-4def47dfa071 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:31.315687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565d804-102d-4f02-8326-4def47dfa071 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:31.317169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 569/1154] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:31.322323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce04d6-0532-433c-bd2a-d87f895bfd3f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:31.322730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce04d6-0532-433c-bd2a-d87f895bfd3f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:31.322890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce04d6-0532-433c-bd2a-d87f895bfd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:31.339712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d9ce04d6-0532-433c-bd2a-d87f895bfd3f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:31.340913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d9ce04d6-0532-433c-bd2a-d87f895bfd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:31.348616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:31.408134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 586/1155] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:31.432161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565d804-102d-4f02-8326-4def47dfa071 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:31.459636 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:31.533322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565d804-102d-4f02-8326-4def47dfa071 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:31.567402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505d805-3cdf-4fab-a61b-a4e6caf3239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:31.568178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d805-3cdf-4fab-a61b-a4e6caf3239d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:31.568457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d805-3cdf-4fab-a61b-a4e6caf3239d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:31.568725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d805-3cdf-4fab-a61b-a4e6caf3239d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:31.578604 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505d805-3cdf-4fab-a61b-a4e6caf3239d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3505d805-3cdf-4fab-a61b-a4e6caf3239d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:01:31.586171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:31.587277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:01:31.588384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 570/1156] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:31.593462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce04d6-0532-433c-bd2a-d87f895bfd3f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:31.691357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce04d6-0532-433c-bd2a-d87f895bfd3f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:31.725203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fccfc-1a23-4086-802d-8425b93bd244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:31.725877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fccfc-1a23-4086-802d-8425b93bd244 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:31.726181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fccfc-1a23-4086-802d-8425b93bd244 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:31.726478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fccfc-1a23-4086-802d-8425b93bd244 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:31.727234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fccfc-1a23-4086-802d-8425b93bd244 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:31.727544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fccfc-1a23-4086-802d-8425b93bd244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:31.728921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fccfc-1a23-4086-802d-8425b93bd244 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:31.737300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 587/1157] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:31.743590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505d805-3cdf-4fab-a61b-a4e6caf3239d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:31.826586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:31.842291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505d805-3cdf-4fab-a61b-a4e6caf3239d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:31.875021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736247be-898e-4867-9c4c-801aa0043b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:31.875896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736247be-898e-4867-9c4c-801aa0043b95 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:31.876182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736247be-898e-4867-9c4c-801aa0043b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:31.876461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736247be-898e-4867-9c4c-801aa0043b95 None admin] PATH_INFO: `/v3/users/1798e7dfe00c4f2eaf8d4f5041e844fe` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:31.877674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736247be-898e-4867-9c4c-801aa0043b95 None admin] RBAC: Authorizing `identity:get_user(user_id=1798e7dfe00c4f2eaf8d4f5041e844fe)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:31.879325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736247be-898e-4867-9c4c-801aa0043b95 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:31.880979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 571/1158] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:31 2022] GET /identity/v3/users/1798e7dfe00c4f2eaf8d4f5041e844fe => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:31.886909 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fccfc-1a23-4086-802d-8425b93bd244 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:31.890897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:31.986741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fccfc-1a23-4086-802d-8425b93bd244 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:32.020845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07cd3a-52b0-4262-9a03-6476b7cf8210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:32.021309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07cd3a-52b0-4262-9a03-6476b7cf8210 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:32.021598 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07cd3a-52b0-4262-9a03-6476b7cf8210 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:32.021928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07cd3a-52b0-4262-9a03-6476b7cf8210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:32.099268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07cd3a-52b0-4262-9a03-6476b7cf8210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:32.100634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07cd3a-52b0-4262-9a03-6476b7cf8210 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:32.103241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:32.195686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 588/1159] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:01:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:01:32.201682 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736247be-898e-4867-9c4c-801aa0043b95 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:32.299357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736247be-898e-4867-9c4c-801aa0043b95 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:32.334628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c4dff-79d2-40e4-97b4-1ff0d9b41a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:32.335489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4dff-79d2-40e4-97b4-1ff0d9b41a86 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:32.335773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4dff-79d2-40e4-97b4-1ff0d9b41a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:32.336052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4dff-79d2-40e4-97b4-1ff0d9b41a86 None admin] PATH_INFO: `/v3/projects/28c0456f601e484e962701770c20dc48` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:32.337241 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c4dff-79d2-40e4-97b4-1ff0d9b41a86 None admin] RBAC: Authorizing `identity:get_project(project_id=28c0456f601e484e962701770c20dc48)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:32.338709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c4dff-79d2-40e4-97b4-1ff0d9b41a86 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:32.340410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 572/1160] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:32 2022] GET /identity/v3/projects/28c0456f601e484e962701770c20dc48 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:32.346528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07cd3a-52b0-4262-9a03-6476b7cf8210 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:32.445978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07cd3a-52b0-4262-9a03-6476b7cf8210 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:32.448448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:32.480748 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cacddf-402c-4800-9fd9-9b849f07232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:32.481411 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cacddf-402c-4800-9fd9-9b849f07232d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:32.481694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cacddf-402c-4800-9fd9-9b849f07232d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:32.481976 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cacddf-402c-4800-9fd9-9b849f07232d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:32.482861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cacddf-402c-4800-9fd9-9b849f07232d None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=28c0456f601e484e962701770c20dc48, user.id=1798e7dfe00c4f2eaf8d4f5041e844fe) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:32.483170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cacddf-402c-4800-9fd9-9b849f07232d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:32.484593 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cacddf-402c-4800-9fd9-9b849f07232d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:32.490964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 589/1161] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:01:32 2022] GET /identity/v3/role_assignments?user.id=1798e7dfe00c4f2eaf8d4f5041e844fe&scope.project.id=28c0456f601e484e962701770c20dc48&role.id=57f1335a97b5490cb0853894c2faf62c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:34.608301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e097116-e39d-4464-b35f-8752f20b87f7 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:34.608813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e097116-e39d-4464-b35f-8752f20b87f7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:34.608813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e097116-e39d-4464-b35f-8752f20b87f7 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:34.610130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 573/1162] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:34.618142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41017a34-ca53-4a00-86f3-6a9f46dbb690 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:34.618733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41017a34-ca53-4a00-86f3-6a9f46dbb690 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:34.618865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41017a34-ca53-4a00-86f3-6a9f46dbb690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:34.636043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-41017a34-ca53-4a00-86f3-6a9f46dbb690 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:34.637216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-41017a34-ca53-4a00-86f3-6a9f46dbb690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:34.702762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 590/1163] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:34.726919 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e097116-e39d-4464-b35f-8752f20b87f7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:34.751356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:34.830524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e097116-e39d-4464-b35f-8752f20b87f7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:34.865842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a379fc-f782-4878-89d1-adf17f51fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:34.866460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a379fc-f782-4878-89d1-adf17f51fb51 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:34.866740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a379fc-f782-4878-89d1-adf17f51fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:34.867016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a379fc-f782-4878-89d1-adf17f51fb51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:34.937461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a379fc-f782-4878-89d1-adf17f51fb51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:34.938957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a379fc-f782-4878-89d1-adf17f51fb51 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:34.961671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:35.037549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 574/1164] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:01:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:01:35.043499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41017a34-ca53-4a00-86f3-6a9f46dbb690 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:35.135279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:35.138991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41017a34-ca53-4a00-86f3-6a9f46dbb690 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:35.172853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4ab01-8474-4340-9f4b-fef501615b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:35.173655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4ab01-8474-4340-9f4b-fef501615b63 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:35.173940 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4ab01-8474-4340-9f4b-fef501615b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:35.174248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4ab01-8474-4340-9f4b-fef501615b63 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:35.181045 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4ab01-8474-4340-9f4b-fef501615b63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:35.182505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4ab01-8474-4340-9f4b-fef501615b63 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-7ba4ab01-8474-4340-9f4b-fef501615b63 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:35.197051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:35.198090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:35.199038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 591/1165] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 11 14:01:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:35.204179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a379fc-f782-4878-89d1-adf17f51fb51 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:35.300272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a379fc-f782-4878-89d1-adf17f51fb51 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:35.322742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:35.335089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b47116-3971-4bcf-b33d-675ec37614c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:35.335752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b47116-3971-4bcf-b33d-675ec37614c2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:35.336032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b47116-3971-4bcf-b33d-675ec37614c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:35.336309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b47116-3971-4bcf-b33d-675ec37614c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:35.337024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b47116-3971-4bcf-b33d-675ec37614c2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:35.337328 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b47116-3971-4bcf-b33d-675ec37614c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:35.338731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b47116-3971-4bcf-b33d-675ec37614c2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:35.346254 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 575/1166] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Jul 11 14:01:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:37.516812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6887-7884-41fb-9885-c93f55834bfa None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:37.517341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6887-7884-41fb-9885-c93f55834bfa None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:37.517341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6887-7884-41fb-9885-c93f55834bfa None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:37.518737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 592/1167] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:37.524669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781f86-3994-43e1-b9bc-32ed3736be53 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:37.525132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781f86-3994-43e1-b9bc-32ed3736be53 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:37.525243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e781f86-3994-43e1-b9bc-32ed3736be53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:37.544471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4e781f86-3994-43e1-b9bc-32ed3736be53 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:37.545720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4e781f86-3994-43e1-b9bc-32ed3736be53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:37.617250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 576/1168] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:37.640297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e6887-7884-41fb-9885-c93f55834bfa None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:37.741567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e6887-7884-41fb-9885-c93f55834bfa None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:37.774883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b20e22-9d19-49fa-a5b6-ce8bfd8278bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:37.775473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b20e22-9d19-49fa-a5b6-ce8bfd8278bb None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:37.775756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b20e22-9d19-49fa-a5b6-ce8bfd8278bb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:37.776030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b20e22-9d19-49fa-a5b6-ce8bfd8278bb None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:37.776777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b20e22-9d19-49fa-a5b6-ce8bfd8278bb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:37.778131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b20e22-9d19-49fa-a5b6-ce8bfd8278bb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:37.793307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 593/1169] 10.222.0.66 () {60 vars in 1138 bytes} [Mon Jul 11 14:01:37 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:01:39.855648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916a29a-201d-41e2-845e-006db21203f1 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:39.856248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916a29a-201d-41e2-845e-006db21203f1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:39.856248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916a29a-201d-41e2-845e-006db21203f1 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:39.857567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 577/1170] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:39.863333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0563845-80ad-4023-ab56-03b6ab428ea6 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:39.863762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0563845-80ad-4023-ab56-03b6ab428ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:39.863891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0563845-80ad-4023-ab56-03b6ab428ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:39.881929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c0563845-80ad-4023-ab56-03b6ab428ea6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:39.882960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c0563845-80ad-4023-ab56-03b6ab428ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:39.896587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:39.950377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 594/1171] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:39.973382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916a29a-201d-41e2-845e-006db21203f1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:40.075404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916a29a-201d-41e2-845e-006db21203f1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:40.091390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:40.110513 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68da2a-0ae3-4a08-b4f3-5b4e889637b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:40.111301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68da2a-0ae3-4a08-b4f3-5b4e889637b2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:40.111578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68da2a-0ae3-4a08-b4f3-5b4e889637b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:40.111849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68da2a-0ae3-4a08-b4f3-5b4e889637b2 None admin] PATH_INFO: `/v3/domains/4d326debde8a47bc995a73adfc6b414c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:40.122578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68da2a-0ae3-4a08-b4f3-5b4e889637b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4d326debde8a47bc995a73adfc6b414c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:40.124004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68da2a-0ae3-4a08-b4f3-5b4e889637b2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:40.125625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 578/1172] 10.222.0.66 () {56 vars in 1183 bytes} [Mon Jul 11 14:01:39 2022] GET /identity/v3/domains/4d326debde8a47bc995a73adfc6b414c => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:40.132183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0563845-80ad-4023-ab56-03b6ab428ea6 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:40.229106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0563845-80ad-4023-ab56-03b6ab428ea6 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:40.262984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b3950-c472-4641-99d5-92f1ef198b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:40.263650 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3950-c472-4641-99d5-92f1ef198b7d None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:40.263948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3950-c472-4641-99d5-92f1ef198b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:40.264230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3950-c472-4641-99d5-92f1ef198b7d None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:40.264952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b3950-c472-4641-99d5-92f1ef198b7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:40.266408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b3950-c472-4641-99d5-92f1ef198b7d None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:40.286147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:40.293172 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 595/1173] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 14:01:40 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:01:42.449427 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978795a6-351c-4eb2-90f6-68325cceb576 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:42.449983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978795a6-351c-4eb2-90f6-68325cceb576 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:42.449983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978795a6-351c-4eb2-90f6-68325cceb576 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:42.451484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 579/1174] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:42.457158 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358608b6-9b11-4faf-90b6-9402c742c7e3 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:42.457746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358608b6-9b11-4faf-90b6-9402c742c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:42.457746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358608b6-9b11-4faf-90b6-9402c742c7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:42.474861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-358608b6-9b11-4faf-90b6-9402c742c7e3 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:42.475986 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-358608b6-9b11-4faf-90b6-9402c742c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:42.542406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 596/1175] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:42.567384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978795a6-351c-4eb2-90f6-68325cceb576 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:42.667716 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978795a6-351c-4eb2-90f6-68325cceb576 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:42.702049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ca0b7-4a78-4fbe-bed7-e09867e0a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:42.702934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca0b7-4a78-4fbe-bed7-e09867e0a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:42.703217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca0b7-4a78-4fbe-bed7-e09867e0a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:42.703493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ca0b7-4a78-4fbe-bed7-e09867e0a0b0 None admin] PATH_INFO: `/v3/domains/4d326debde8a47bc995a73adfc6b414c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:42.704667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ca0b7-4a78-4fbe-bed7-e09867e0a0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4d326debde8a47bc995a73adfc6b414c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:42.706096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ca0b7-4a78-4fbe-bed7-e09867e0a0b0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:42.708451 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 580/1176] 10.222.0.66 () {56 vars in 1183 bytes} [Mon Jul 11 14:01:42 2022] GET /identity/v3/domains/4d326debde8a47bc995a73adfc6b414c => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:01:42.716252 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358608b6-9b11-4faf-90b6-9402c742c7e3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:42.813279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358608b6-9b11-4faf-90b6-9402c742c7e3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:42.841801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:42.848033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001b1e6-d7b2-4ae3-92f5-01725c0e5448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:42.848715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001b1e6-d7b2-4ae3-92f5-01725c0e5448 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:42.849003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001b1e6-d7b2-4ae3-92f5-01725c0e5448 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:42.849285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001b1e6-d7b2-4ae3-92f5-01725c0e5448 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:42.850001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001b1e6-d7b2-4ae3-92f5-01725c0e5448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:42.851477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001b1e6-d7b2-4ae3-92f5-01725c0e5448 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:42.871849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 597/1177] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 14:01:42 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:01:44.949083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be059b-1197-41e1-8ecc-dd53d41888cd None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:44.949664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be059b-1197-41e1-8ecc-dd53d41888cd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:44.949664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be059b-1197-41e1-8ecc-dd53d41888cd None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:44.951057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 581/1178] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:44.958295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf05858-3993-4d9c-b8fc-3ee6c48b77f6 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:44.958795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf05858-3993-4d9c-b8fc-3ee6c48b77f6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:44.958895 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf05858-3993-4d9c-b8fc-3ee6c48b77f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:44.975581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2bf05858-3993-4d9c-b8fc-3ee6c48b77f6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:44.976783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2bf05858-3993-4d9c-b8fc-3ee6c48b77f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:45.044076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 598/1179] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:45.068347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be059b-1197-41e1-8ecc-dd53d41888cd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:45.117440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:45.171931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be059b-1197-41e1-8ecc-dd53d41888cd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:45.206429 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d5cd1-baaf-4c2a-a24e-c6f8771bce15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:45.207154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d5cd1-baaf-4c2a-a24e-c6f8771bce15 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:45.207438 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d5cd1-baaf-4c2a-a24e-c6f8771bce15 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:45.207714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d5cd1-baaf-4c2a-a24e-c6f8771bce15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:45.218208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d5cd1-baaf-4c2a-a24e-c6f8771bce15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6d9d5cd1-baaf-4c2a-a24e-c6f8771bce15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:01:45.225940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:45.227211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:01:45.228171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 582/1180] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:01:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:45.233586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf05858-3993-4d9c-b8fc-3ee6c48b77f6 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:45.339926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf05858-3993-4d9c-b8fc-3ee6c48b77f6 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:45.357302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:45.379189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1781-97ba-4c13-b3e8-f25900f145c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:45.379844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1781-97ba-4c13-b3e8-f25900f145c9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:45.380137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1781-97ba-4c13-b3e8-f25900f145c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:45.380437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1781-97ba-4c13-b3e8-f25900f145c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:45.381232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1781-97ba-4c13-b3e8-f25900f145c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:45.381572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1781-97ba-4c13-b3e8-f25900f145c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:45.383058 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1781-97ba-4c13-b3e8-f25900f145c9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:45.391489 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 599/1181] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:45.397701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d5cd1-baaf-4c2a-a24e-c6f8771bce15 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:45.502678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d5cd1-baaf-4c2a-a24e-c6f8771bce15 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:45.506110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:45.540087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f39566-570c-4be9-86b7-225b798b6ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:45.540971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f39566-570c-4be9-86b7-225b798b6ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:45.541255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f39566-570c-4be9-86b7-225b798b6ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:45.541538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f39566-570c-4be9-86b7-225b798b6ef7 None admin] PATH_INFO: `/v3/users/bc52bd34016547f98657fb7cbc2111a7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:45.556293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f39566-570c-4be9-86b7-225b798b6ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=bc52bd34016547f98657fb7cbc2111a7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:45.557757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f39566-570c-4be9-86b7-225b798b6ef7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:45.559531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 583/1182] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:45 2022] GET /identity/v3/users/bc52bd34016547f98657fb7cbc2111a7 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:45.565330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1781-97ba-4c13-b3e8-f25900f145c9 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:45.665064 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1781-97ba-4c13-b3e8-f25900f145c9 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:45.699911 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798a2ab-3e19-4f10-8e6b-b5798d03a49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:45.700476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798a2ab-3e19-4f10-8e6b-b5798d03a49b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:45.700766 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798a2ab-3e19-4f10-8e6b-b5798d03a49b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:45.701049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798a2ab-3e19-4f10-8e6b-b5798d03a49b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:45.746670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:45.771320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798a2ab-3e19-4f10-8e6b-b5798d03a49b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:45.772700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798a2ab-3e19-4f10-8e6b-b5798d03a49b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:45.871164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 600/1183] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:01:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:01:45.877110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f39566-570c-4be9-86b7-225b798b6ef7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:45.975511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f39566-570c-4be9-86b7-225b798b6ef7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:46.010792 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28266e-c9e6-4fa1-913d-9264717c091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:46.011681 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28266e-c9e6-4fa1-913d-9264717c091d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:46.011941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28266e-c9e6-4fa1-913d-9264717c091d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:46.012215 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28266e-c9e6-4fa1-913d-9264717c091d None admin] PATH_INFO: `/v3/projects/94d393f01df54cb48a02552fa65f97df` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:46.013423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28266e-c9e6-4fa1-913d-9264717c091d None admin] RBAC: Authorizing `identity:get_project(project_id=94d393f01df54cb48a02552fa65f97df)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:46.014900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28266e-c9e6-4fa1-913d-9264717c091d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:46.016625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 584/1184] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:45 2022] GET /identity/v3/projects/94d393f01df54cb48a02552fa65f97df => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:46.026966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798a2ab-3e19-4f10-8e6b-b5798d03a49b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:46.108481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:46.132257 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798a2ab-3e19-4f10-8e6b-b5798d03a49b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:46.167110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46fbe8-101a-4c21-bc81-d3d72ff12393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:46.167829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fbe8-101a-4c21-bc81-d3d72ff12393 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:46.168123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fbe8-101a-4c21-bc81-d3d72ff12393 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:46.168399 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46fbe8-101a-4c21-bc81-d3d72ff12393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:46.169450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fbe8-101a-4c21-bc81-d3d72ff12393 None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=94d393f01df54cb48a02552fa65f97df, user.id=bc52bd34016547f98657fb7cbc2111a7) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:46.169577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fbe8-101a-4c21-bc81-d3d72ff12393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:46.171109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46fbe8-101a-4c21-bc81-d3d72ff12393 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:46.177524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 601/1185] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:01:46 2022] GET /identity/v3/role_assignments?user.id=bc52bd34016547f98657fb7cbc2111a7&scope.project.id=94d393f01df54cb48a02552fa65f97df&role.id=57f1335a97b5490cb0853894c2faf62c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:48.200429 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424933e-dc12-40ff-85e0-6c4652028939 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:48.200992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424933e-dc12-40ff-85e0-6c4652028939 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:48.201089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424933e-dc12-40ff-85e0-6c4652028939 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:48.202487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 585/1186] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:48.208409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bea02-fd95-4d01-893c-edba5508a39b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:48.208839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bea02-fd95-4d01-893c-edba5508a39b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:48.208996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bea02-fd95-4d01-893c-edba5508a39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:48.226359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d43bea02-fd95-4d01-893c-edba5508a39b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:48.227542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d43bea02-fd95-4d01-893c-edba5508a39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:48.292316 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 602/1187] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:48.314808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424933e-dc12-40ff-85e0-6c4652028939 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:48.345221 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:48.416747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424933e-dc12-40ff-85e0-6c4652028939 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:48.449559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765dd59-17fa-4502-8e6e-32a06ba8364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:48.450371 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765dd59-17fa-4502-8e6e-32a06ba8364d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:48.450712 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765dd59-17fa-4502-8e6e-32a06ba8364d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:48.450941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765dd59-17fa-4502-8e6e-32a06ba8364d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:48.461832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765dd59-17fa-4502-8e6e-32a06ba8364d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6765dd59-17fa-4502-8e6e-32a06ba8364d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:01:48.469609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:48.470732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:01:48.472572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 586/1188] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:48.477514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bea02-fd95-4d01-893c-edba5508a39b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:48.545108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:48.575054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bea02-fd95-4d01-893c-edba5508a39b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:48.609069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c74f-0d6a-412b-b400-7d83a7885026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:48.609735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c74f-0d6a-412b-b400-7d83a7885026 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:48.610022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c74f-0d6a-412b-b400-7d83a7885026 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:48.610337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619c74f-0d6a-412b-b400-7d83a7885026 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:48.611091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c74f-0d6a-412b-b400-7d83a7885026 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:48.611400 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c74f-0d6a-412b-b400-7d83a7885026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:48.612829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619c74f-0d6a-412b-b400-7d83a7885026 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:48.621037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 603/1189] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:48.626856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765dd59-17fa-4502-8e6e-32a06ba8364d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:48.733988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:48.743925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765dd59-17fa-4502-8e6e-32a06ba8364d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:48.777855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24558aa6-46ab-4267-83b1-d1daa23d07c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:48.778747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24558aa6-46ab-4267-83b1-d1daa23d07c2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:48.779026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24558aa6-46ab-4267-83b1-d1daa23d07c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:48.779301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24558aa6-46ab-4267-83b1-d1daa23d07c2 None admin] PATH_INFO: `/v3/users/bc52bd34016547f98657fb7cbc2111a7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:48.780472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24558aa6-46ab-4267-83b1-d1daa23d07c2 None admin] RBAC: Authorizing `identity:get_user(user_id=bc52bd34016547f98657fb7cbc2111a7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:48.781905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24558aa6-46ab-4267-83b1-d1daa23d07c2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:48.783542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 587/1190] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:48 2022] GET /identity/v3/users/bc52bd34016547f98657fb7cbc2111a7 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:48.789513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c74f-0d6a-412b-b400-7d83a7885026 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:48.889468 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619c74f-0d6a-412b-b400-7d83a7885026 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:48.922457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f30983-4558-4bf3-a4e9-3ba43abce12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:48.923321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f30983-4558-4bf3-a4e9-3ba43abce12c None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:48.923605 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f30983-4558-4bf3-a4e9-3ba43abce12c None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:48.923882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f30983-4558-4bf3-a4e9-3ba43abce12c None admin] PATH_INFO: `/v3/projects/94d393f01df54cb48a02552fa65f97df` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:48.925568 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f30983-4558-4bf3-a4e9-3ba43abce12c None admin] RBAC: Authorizing `identity:get_project(project_id=94d393f01df54cb48a02552fa65f97df)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:48.927026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f30983-4558-4bf3-a4e9-3ba43abce12c None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:48.928751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 604/1191] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:48 2022] GET /identity/v3/projects/94d393f01df54cb48a02552fa65f97df => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:48.935933 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24558aa6-46ab-4267-83b1-d1daa23d07c2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:49.045276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24558aa6-46ab-4267-83b1-d1daa23d07c2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:49.079576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99498d-29b8-46e4-aa00-36548933423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:49.080457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99498d-29b8-46e4-aa00-36548933423d None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:49.080739 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99498d-29b8-46e4-aa00-36548933423d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:49.081052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99498d-29b8-46e4-aa00-36548933423d None admin] PATH_INFO: `/v3/projects/94d393f01df54cb48a02552fa65f97df/users/bc52bd34016547f98657fb7cbc2111a7/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:49.083158 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99498d-29b8-46e4-aa00-36548933423d None admin] RBAC: Authorizing `identity:create_grant(project_id=94d393f01df54cb48a02552fa65f97df, user_id=bc52bd34016547f98657fb7cbc2111a7, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:49.084591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99498d-29b8-46e4-aa00-36548933423d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:49.098116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 588/1192] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:01:48 2022] PUT /identity/v3/projects/94d393f01df54cb48a02552fa65f97df/users/bc52bd34016547f98657fb7cbc2111a7/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:01:51.094944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce401f-70ec-4e1a-af37-5d0e253d35db None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:51.095507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce401f-70ec-4e1a-af37-5d0e253d35db None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:51.095507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce401f-70ec-4e1a-af37-5d0e253d35db None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:51.097395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 605/1193] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:01:51.102929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c2bb-fb36-48eb-8632-55bce46e4b24 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:51.103368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c2bb-fb36-48eb-8632-55bce46e4b24 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:51.103495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c2bb-fb36-48eb-8632-55bce46e4b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:51.120544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0811c2bb-fb36-48eb-8632-55bce46e4b24 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:01:51.121747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0811c2bb-fb36-48eb-8632-55bce46e4b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:01:51.134810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:51.189946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 589/1194] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:01:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:01:51.214498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce401f-70ec-4e1a-af37-5d0e253d35db None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:51.217387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:51.315652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce401f-70ec-4e1a-af37-5d0e253d35db None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:51.349755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7cf0b-2ddc-4ce9-ae26-23d38522fe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:51.350509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7cf0b-2ddc-4ce9-ae26-23d38522fe0d None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:51.350794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7cf0b-2ddc-4ce9-ae26-23d38522fe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:51.351075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7cf0b-2ddc-4ce9-ae26-23d38522fe0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:51.361388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7cf0b-2ddc-4ce9-ae26-23d38522fe0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-2ac7cf0b-2ddc-4ce9-ae26-23d38522fe0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:01:51.368929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:01:51.370072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:01:51.370997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 606/1195] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:01:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:01:51.376329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c2bb-fb36-48eb-8632-55bce46e4b24 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:51.472904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811c2bb-fb36-48eb-8632-55bce46e4b24 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:51.505879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58e60b-7ad3-4bf4-a978-d289473228b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:51.506563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e60b-7ad3-4bf4-a978-d289473228b7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:51.506850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e60b-7ad3-4bf4-a978-d289473228b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:51.507122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e60b-7ad3-4bf4-a978-d289473228b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:51.507861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58e60b-7ad3-4bf4-a978-d289473228b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:51.508167 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58e60b-7ad3-4bf4-a978-d289473228b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:51.509531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58e60b-7ad3-4bf4-a978-d289473228b7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:51.517401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 590/1196] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:01:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:51.524165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7cf0b-2ddc-4ce9-ae26-23d38522fe0d None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:51.583889 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:51.621986 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7cf0b-2ddc-4ce9-ae26-23d38522fe0d None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:51.655374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d52b-bea2-4243-9f34-1d51ecb4dee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:51.656226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d52b-bea2-4243-9f34-1d51ecb4dee6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:51.656507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d52b-bea2-4243-9f34-1d51ecb4dee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:51.656779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860d52b-bea2-4243-9f34-1d51ecb4dee6 None admin] PATH_INFO: `/v3/users/bc52bd34016547f98657fb7cbc2111a7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:51.657943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860d52b-bea2-4243-9f34-1d51ecb4dee6 None admin] RBAC: Authorizing `identity:get_user(user_id=bc52bd34016547f98657fb7cbc2111a7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:51.659926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860d52b-bea2-4243-9f34-1d51ecb4dee6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:51.661533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 607/1197] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Jul 11 14:01:51 2022] GET /identity/v3/users/bc52bd34016547f98657fb7cbc2111a7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:51.667313 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58e60b-7ad3-4bf4-a978-d289473228b7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:51.680679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:51.769711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58e60b-7ad3-4bf4-a978-d289473228b7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:51.803893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313f352-4fd8-4eb0-8777-68dd0602264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:51.804548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313f352-4fd8-4eb0-8777-68dd0602264f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:51.804837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313f352-4fd8-4eb0-8777-68dd0602264f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:51.805119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313f352-4fd8-4eb0-8777-68dd0602264f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:51.877397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313f352-4fd8-4eb0-8777-68dd0602264f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:51.878857 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313f352-4fd8-4eb0-8777-68dd0602264f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:51.890168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:51.977434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 591/1198] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:01:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:01:51.983355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d52b-bea2-4243-9f34-1d51ecb4dee6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:52.079565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860d52b-bea2-4243-9f34-1d51ecb4dee6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:52.107751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:52.113934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e06abe-1e3e-4e95-9b4f-9445914ef53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:52.114821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e06abe-1e3e-4e95-9b4f-9445914ef53e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:52.115107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e06abe-1e3e-4e95-9b4f-9445914ef53e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:52.115385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e06abe-1e3e-4e95-9b4f-9445914ef53e None admin] PATH_INFO: `/v3/projects/94d393f01df54cb48a02552fa65f97df` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:52.116583 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e06abe-1e3e-4e95-9b4f-9445914ef53e None admin] RBAC: Authorizing `identity:get_project(project_id=94d393f01df54cb48a02552fa65f97df)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:52.118015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e06abe-1e3e-4e95-9b4f-9445914ef53e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:52.119770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 608/1199] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Jul 11 14:01:51 2022] GET /identity/v3/projects/94d393f01df54cb48a02552fa65f97df => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:01:52.125828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313f352-4fd8-4eb0-8777-68dd0602264f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:01:52.222909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313f352-4fd8-4eb0-8777-68dd0602264f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:01:52.234013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:01:52.257439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f9fc8-8ce3-4b2b-9f5b-0b0e068d7a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:01:52.258098 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9fc8-8ce3-4b2b-9f5b-0b0e068d7a83 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:01:52.258410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9fc8-8ce3-4b2b-9f5b-0b0e068d7a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:01:52.258685 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9fc8-8ce3-4b2b-9f5b-0b0e068d7a83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:01:52.259509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f9fc8-8ce3-4b2b-9f5b-0b0e068d7a83 None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=94d393f01df54cb48a02552fa65f97df, user.id=bc52bd34016547f98657fb7cbc2111a7) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:01:52.259819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f9fc8-8ce3-4b2b-9f5b-0b0e068d7a83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:01:52.261237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f9fc8-8ce3-4b2b-9f5b-0b0e068d7a83 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:01:52.266940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 592/1200] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:01:52 2022] GET /identity/v3/role_assignments?user.id=bc52bd34016547f98657fb7cbc2111a7&scope.project.id=94d393f01df54cb48a02552fa65f97df&role.id=57f1335a97b5490cb0853894c2faf62c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:02.112731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:02.264366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=13 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:48.845290 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968321-2cb9-49b9-bdbc-a006784366e0 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:48.845904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968321-2cb9-49b9-bdbc-a006784366e0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:48.845904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968321-2cb9-49b9-bdbc-a006784366e0 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:48.847451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 609/1201] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:02:48.853214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622af5c-a1b4-4b06-9d5b-854fffa8f09e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:48.853729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622af5c-a1b4-4b06-9d5b-854fffa8f09e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:48.853843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622af5c-a1b4-4b06-9d5b-854fffa8f09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:48.872777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a622af5c-a1b4-4b06-9d5b-854fffa8f09e None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:02:48.874032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a622af5c-a1b4-4b06-9d5b-854fffa8f09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:02:48.960659 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 593/1202] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:02:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:02:48.991555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c968321-2cb9-49b9-bdbc-a006784366e0 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:49.137274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c968321-2cb9-49b9-bdbc-a006784366e0 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:49.180305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b34cb5-035a-4172-951c-6f05c79a8efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:49.181175 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34cb5-035a-4172-951c-6f05c79a8efb None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:49.181469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34cb5-035a-4172-951c-6f05c79a8efb None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:49.181743 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b34cb5-035a-4172-951c-6f05c79a8efb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:49.198539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b34cb5-035a-4172-951c-6f05c79a8efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:49.200312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b34cb5-035a-4172-951c-6f05c79a8efb None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-33b34cb5-035a-4172-951c-6f05c79a8efb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:02:49.226638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:02:49.231227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:02:49.232330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:02:49.232330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:02:49.232330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:02:49.232330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:02:49.232330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 610/1203] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:02:49.234935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622af5c-a1b4-4b06-9d5b-854fffa8f09e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:49.375108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622af5c-a1b4-4b06-9d5b-854fffa8f09e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:49.421871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:49.430140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17588cc-3281-4861-b139-952b6203a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:49.431006 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17588cc-3281-4861-b139-952b6203a4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:49.431459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17588cc-3281-4861-b139-952b6203a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:49.431909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17588cc-3281-4861-b139-952b6203a4b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:49.433040 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17588cc-3281-4861-b139-952b6203a4b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:49.433487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17588cc-3281-4861-b139-952b6203a4b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:49.435723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17588cc-3281-4861-b139-952b6203a4b5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:49.454428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 594/1204] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:49.461219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b34cb5-035a-4172-951c-6f05c79a8efb None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:49.533524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:49.592968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b34cb5-035a-4172-951c-6f05c79a8efb None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:49.646862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a6108-1ae3-4482-bbef-56f7e760ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:49.647590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a6108-1ae3-4482-bbef-56f7e760ac69 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:49.647886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a6108-1ae3-4482-bbef-56f7e760ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:49.648171 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a6108-1ae3-4482-bbef-56f7e760ac69 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:49.648905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a6108-1ae3-4482-bbef-56f7e760ac69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:49.650377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a6108-1ae3-4482-bbef-56f7e760ac69 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:49.679836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 611/1205] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Jul 11 14:02:49 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:02:52.049754 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f82680-5dd6-46ee-8cce-e9dbd8762ec0 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:52.050346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f82680-5dd6-46ee-8cce-e9dbd8762ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:52.050346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f82680-5dd6-46ee-8cce-e9dbd8762ec0 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:52.051851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 595/1206] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:02:52.058183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a18dc-ecb0-4883-9bfa-55b0a28a7fa2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:52.058672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a18dc-ecb0-4883-9bfa-55b0a28a7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:52.058764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a18dc-ecb0-4883-9bfa-55b0a28a7fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:52.079828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-309a18dc-ecb0-4883-9bfa-55b0a28a7fa2 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:02:52.081366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-309a18dc-ecb0-4883-9bfa-55b0a28a7fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:02:52.165482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 612/1207] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:02:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:02:52.192457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f82680-5dd6-46ee-8cce-e9dbd8762ec0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:52.337491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f82680-5dd6-46ee-8cce-e9dbd8762ec0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:52.377170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cba28-4ddb-482f-bc6a-e5cd33b73154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:52.378115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cba28-4ddb-482f-bc6a-e5cd33b73154 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:52.379173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cba28-4ddb-482f-bc6a-e5cd33b73154 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:52.379173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cba28-4ddb-482f-bc6a-e5cd33b73154 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:52.391977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cba28-4ddb-482f-bc6a-e5cd33b73154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-de6cba28-4ddb-482f-bc6a-e5cd33b73154 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:02:52.404573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:02:52.405846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:02:52.411952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 596/1208] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:02:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:02:52.412773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a18dc-ecb0-4883-9bfa-55b0a28a7fa2 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:52.461463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:52.532206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a18dc-ecb0-4883-9bfa-55b0a28a7fa2 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:52.570523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e640ae7-5f1c-410b-bba3-a1c31dc02983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:52.571109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640ae7-5f1c-410b-bba3-a1c31dc02983 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:52.571393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640ae7-5f1c-410b-bba3-a1c31dc02983 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:52.571668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640ae7-5f1c-410b-bba3-a1c31dc02983 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:52.572419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e640ae7-5f1c-410b-bba3-a1c31dc02983 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:52.572727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e640ae7-5f1c-410b-bba3-a1c31dc02983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:52.574112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e640ae7-5f1c-410b-bba3-a1c31dc02983 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:52.588376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 613/1209] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:02:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:52.589647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cba28-4ddb-482f-bc6a-e5cd33b73154 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:52.661110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:52.743026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cba28-4ddb-482f-bc6a-e5cd33b73154 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:52.788019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94295c56-5160-404b-a143-fb666ee9428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:52.788882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295c56-5160-404b-a143-fb666ee9428b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:52.790121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295c56-5160-404b-a143-fb666ee9428b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:52.790121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295c56-5160-404b-a143-fb666ee9428b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:52.802531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94295c56-5160-404b-a143-fb666ee9428b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:52.804137 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94295c56-5160-404b-a143-fb666ee9428b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-94295c56-5160-404b-a143-fb666ee9428b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:02:52.825532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:02:52.826887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:02:52.828741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:02:52.828741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:02:52.828741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:02:52.828741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:02:52.828741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 597/1210] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:02:52.840000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e640ae7-5f1c-410b-bba3-a1c31dc02983 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:52.961483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:52.965054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e640ae7-5f1c-410b-bba3-a1c31dc02983 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:53.006346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede75ac8-e5b4-4002-b338-10bf4a676543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:53.007026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede75ac8-e5b4-4002-b338-10bf4a676543 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:53.007318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede75ac8-e5b4-4002-b338-10bf4a676543 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:53.007618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede75ac8-e5b4-4002-b338-10bf4a676543 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:53.008397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede75ac8-e5b4-4002-b338-10bf4a676543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:53.008708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede75ac8-e5b4-4002-b338-10bf4a676543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:53.011322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede75ac8-e5b4-4002-b338-10bf4a676543 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:53.025998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 614/1211] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:53.031907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94295c56-5160-404b-a143-fb666ee9428b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:53.156970 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94295c56-5160-404b-a143-fb666ee9428b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:53.158990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:53.205500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657e682-5ea5-4096-9b42-d01a5f06666e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:53.206701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e682-5ea5-4096-9b42-d01a5f06666e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:53.206701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e682-5ea5-4096-9b42-d01a5f06666e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:53.206911 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e682-5ea5-4096-9b42-d01a5f06666e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:53.215333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657e682-5ea5-4096-9b42-d01a5f06666e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:53.216740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657e682-5ea5-4096-9b42-d01a5f06666e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d657e682-5ea5-4096-9b42-d01a5f06666e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:02:53.234851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:02:53.236084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:02:53.237212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:02:53.237212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:02:53.237212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:02:53.237212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:02:53.237212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:02:53.237212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:02:53.237212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:02:53.237212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:02:53.237212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:02:53.237212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:02:53.237212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 598/1212] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:02:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:02:53.244543 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede75ac8-e5b4-4002-b338-10bf4a676543 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:53.389154 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede75ac8-e5b4-4002-b338-10bf4a676543 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:53.434782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f786a-74b4-470a-b31e-5308067458d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:53.434782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f786a-74b4-470a-b31e-5308067458d0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:53.435101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f786a-74b4-470a-b31e-5308067458d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:53.435289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f786a-74b4-470a-b31e-5308067458d0 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:53.436364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f786a-74b4-470a-b31e-5308067458d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:53.436838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f786a-74b4-470a-b31e-5308067458d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:53.438938 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f786a-74b4-470a-b31e-5308067458d0 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:53.462426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 615/1213] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 11 14:02:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:53.470594 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657e682-5ea5-4096-9b42-d01a5f06666e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:53.595506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657e682-5ea5-4096-9b42-d01a5f06666e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:53.638200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22962e0a-eff1-479b-83f6-4dadc9f8106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:53.638867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22962e0a-eff1-479b-83f6-4dadc9f8106c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:53.639179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22962e0a-eff1-479b-83f6-4dadc9f8106c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:53.639432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22962e0a-eff1-479b-83f6-4dadc9f8106c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:53.678330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:53.727907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22962e0a-eff1-479b-83f6-4dadc9f8106c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:53.729403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22962e0a-eff1-479b-83f6-4dadc9f8106c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:53.868625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 599/1214] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:02:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 11 14:02:53.869913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f786a-74b4-470a-b31e-5308067458d0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:53.893440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:53.996454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f786a-74b4-470a-b31e-5308067458d0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:54.034558 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252015a-afa2-46c9-ade0-f44650a7f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:54.035520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252015a-afa2-46c9-ade0-f44650a7f584 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:54.035907 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252015a-afa2-46c9-ade0-f44650a7f584 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:54.036284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252015a-afa2-46c9-ade0-f44650a7f584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:54.047670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252015a-afa2-46c9-ade0-f44650a7f584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:54.049476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252015a-afa2-46c9-ade0-f44650a7f584 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-8252015a-afa2-46c9-ade0-f44650a7f584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:02:54.069971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:02:54.071327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:02:54.072423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:02:54.072423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:02:54.072423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:02:54.072423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:02:54.073542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 616/1215] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:02:54.079866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22962e0a-eff1-479b-83f6-4dadc9f8106c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:54.149817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:54.192587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22962e0a-eff1-479b-83f6-4dadc9f8106c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:54.230458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ac76f-0648-42bf-950e-3c27a4b6f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:54.231272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac76f-0648-42bf-950e-3c27a4b6f212 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:54.231658 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac76f-0648-42bf-950e-3c27a4b6f212 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:54.232038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ac76f-0648-42bf-950e-3c27a4b6f212 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:54.232864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ac76f-0648-42bf-950e-3c27a4b6f212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:54.233287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ac76f-0648-42bf-950e-3c27a4b6f212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:54.235432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ac76f-0648-42bf-950e-3c27a4b6f212 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:54.250318 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 600/1216] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:54.255985 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252015a-afa2-46c9-ade0-f44650a7f584 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:54.330998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:54.369415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252015a-afa2-46c9-ade0-f44650a7f584 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:54.409028 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d45dbd-e9c2-4caf-bec9-076d95dcc928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:54.409987 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d45dbd-e9c2-4caf-bec9-076d95dcc928 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:54.410409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d45dbd-e9c2-4caf-bec9-076d95dcc928 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:54.410794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d45dbd-e9c2-4caf-bec9-076d95dcc928 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:54.418548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d45dbd-e9c2-4caf-bec9-076d95dcc928 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:54.420233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d45dbd-e9c2-4caf-bec9-076d95dcc928 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b7d45dbd-e9c2-4caf-bec9-076d95dcc928 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:02:54.434727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:02:54.435902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:02:54.437513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:02:54.437513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:02:54.437513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:02:54.437513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:02:54.437513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:02:54.437513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:02:54.437513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:02:54.437513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:02:54.439254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 617/1217] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:02:54.445062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ac76f-0648-42bf-950e-3c27a4b6f212 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:54.568349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ac76f-0648-42bf-950e-3c27a4b6f212 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:54.594608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:54.616387 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb6bee-d9ee-47ea-b406-f4891331c608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:54.617142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6bee-d9ee-47ea-b406-f4891331c608 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:54.617524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6bee-d9ee-47ea-b406-f4891331c608 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:54.617804 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6bee-d9ee-47ea-b406-f4891331c608 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:54.618822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb6bee-d9ee-47ea-b406-f4891331c608 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:54.619241 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb6bee-d9ee-47ea-b406-f4891331c608 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:54.621054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb6bee-d9ee-47ea-b406-f4891331c608 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:54.635232 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 601/1218] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:54.642194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d45dbd-e9c2-4caf-bec9-076d95dcc928 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:54.766315 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d45dbd-e9c2-4caf-bec9-076d95dcc928 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:54.800451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:54.806997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e5ced-b94f-45f6-a654-bb2b77ddee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:54.807658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e5ced-b94f-45f6-a654-bb2b77ddee5f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:54.807939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e5ced-b94f-45f6-a654-bb2b77ddee5f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:54.808214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e5ced-b94f-45f6-a654-bb2b77ddee5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:54.809084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e5ced-b94f-45f6-a654-bb2b77ddee5f None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=2949783e08504cfba3dc52dcf8b6a015) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:54.809397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e5ced-b94f-45f6-a654-bb2b77ddee5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:54.810895 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e5ced-b94f-45f6-a654-bb2b77ddee5f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:54.818727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 618/1219] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:02:54 2022] GET /identity/v3/role_assignments?user.id=2949783e08504cfba3dc52dcf8b6a015&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:02:57.230745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a5f20-16f4-464a-889a-1219c94e85c1 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:57.231306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a5f20-16f4-464a-889a-1219c94e85c1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:57.231512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a5f20-16f4-464a-889a-1219c94e85c1 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:57.233077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 602/1220] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:02:57.239694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4ba9-08c2-48c8-9449-c9967b192812 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:57.240276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4ba9-08c2-48c8-9449-c9967b192812 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:57.240381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4ba9-08c2-48c8-9449-c9967b192812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:57.258465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b0aa4ba9-08c2-48c8-9449-c9967b192812 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:02:57.259674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b0aa4ba9-08c2-48c8-9449-c9967b192812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:02:57.333116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 619/1221] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:02:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:02:57.356739 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a5f20-16f4-464a-889a-1219c94e85c1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:57.471329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a5f20-16f4-464a-889a-1219c94e85c1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:57.513966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a82e8-559b-496d-9db5-96df19546a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:57.515521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a82e8-559b-496d-9db5-96df19546a43 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:57.515903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a82e8-559b-496d-9db5-96df19546a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:57.516377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a82e8-559b-496d-9db5-96df19546a43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:57.526963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a82e8-559b-496d-9db5-96df19546a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a36a82e8-559b-496d-9db5-96df19546a43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:02:57.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:02:57.535741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:02:57.536628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 603/1222] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:02:57.542831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa4ba9-08c2-48c8-9449-c9967b192812 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:57.659704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa4ba9-08c2-48c8-9449-c9967b192812 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:57.684956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:57.706008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f8a8d-b13b-4c8c-a4b8-70881084c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:57.706970 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f8a8d-b13b-4c8c-a4b8-70881084c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:57.707517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f8a8d-b13b-4c8c-a4b8-70881084c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:57.707818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f8a8d-b13b-4c8c-a4b8-70881084c6f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:57.709173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f8a8d-b13b-4c8c-a4b8-70881084c6f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:57.709556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f8a8d-b13b-4c8c-a4b8-70881084c6f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:57.711582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f8a8d-b13b-4c8c-a4b8-70881084c6f1 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:57.723741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 620/1223] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:02:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:57.731439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a82e8-559b-496d-9db5-96df19546a43 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:57.791152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:57.882608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a82e8-559b-496d-9db5-96df19546a43 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:57.925838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099592a9-9a49-49eb-abf7-76f52c46f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:57.926707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099592a9-9a49-49eb-abf7-76f52c46f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:57.926991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099592a9-9a49-49eb-abf7-76f52c46f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:57.927276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099592a9-9a49-49eb-abf7-76f52c46f1e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:57.939188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099592a9-9a49-49eb-abf7-76f52c46f1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:57.940647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099592a9-9a49-49eb-abf7-76f52c46f1e2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-099592a9-9a49-49eb-abf7-76f52c46f1e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:02:57.961375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:02:57.962750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:02:57.963741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:02:57.963741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:02:57.963741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:02:57.963741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:02:57.963741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 604/1224] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:02:57.969685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f8a8d-b13b-4c8c-a4b8-70881084c6f1 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:58.090042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f8a8d-b13b-4c8c-a4b8-70881084c6f1 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:58.132123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0121913-1893-4b34-a1bb-d3610d922955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:58.132801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121913-1893-4b34-a1bb-d3610d922955 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:58.133089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121913-1893-4b34-a1bb-d3610d922955 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:58.133369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121913-1893-4b34-a1bb-d3610d922955 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:58.134108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0121913-1893-4b34-a1bb-d3610d922955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:58.134450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0121913-1893-4b34-a1bb-d3610d922955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:58.136040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0121913-1893-4b34-a1bb-d3610d922955 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:58.156837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 621/1225] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:58.158818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099592a9-9a49-49eb-abf7-76f52c46f1e2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:58.269539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:58.277393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099592a9-9a49-49eb-abf7-76f52c46f1e2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:58.316467 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889f4ae-4065-4eff-9ae3-38a8f60232cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:58.317279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f4ae-4065-4eff-9ae3-38a8f60232cb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:58.317643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f4ae-4065-4eff-9ae3-38a8f60232cb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:58.317848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f4ae-4065-4eff-9ae3-38a8f60232cb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:58.326833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889f4ae-4065-4eff-9ae3-38a8f60232cb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:58.329083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889f4ae-4065-4eff-9ae3-38a8f60232cb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1889f4ae-4065-4eff-9ae3-38a8f60232cb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:02:58.346863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:02:58.348107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:02:58.349148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:02:58.349148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:02:58.349148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:02:58.349148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:02:58.349148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:02:58.349148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:02:58.349148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:02:58.349148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:02:58.349148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:02:58.349148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:02:58.349148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 605/1226] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:02:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:02:58.354041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0121913-1893-4b34-a1bb-d3610d922955 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:58.409558 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:58.478658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0121913-1893-4b34-a1bb-d3610d922955 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:58.521674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc29a3-3759-44c6-94d1-9c91a3e442a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:58.522518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc29a3-3759-44c6-94d1-9c91a3e442a3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:58.522834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc29a3-3759-44c6-94d1-9c91a3e442a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:58.523082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc29a3-3759-44c6-94d1-9c91a3e442a3 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:58.524013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc29a3-3759-44c6-94d1-9c91a3e442a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:58.524324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc29a3-3759-44c6-94d1-9c91a3e442a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:58.526318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc29a3-3759-44c6-94d1-9c91a3e442a3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:58.547224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 622/1227] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 11 14:02:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:58.554208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889f4ae-4065-4eff-9ae3-38a8f60232cb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:58.669136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889f4ae-4065-4eff-9ae3-38a8f60232cb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:58.714275 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974a7ae-8f19-4a59-856f-590454ca022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:58.715216 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974a7ae-8f19-4a59-856f-590454ca022d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:58.715531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974a7ae-8f19-4a59-856f-590454ca022d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:58.715962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974a7ae-8f19-4a59-856f-590454ca022d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:58.729560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974a7ae-8f19-4a59-856f-590454ca022d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:58.732203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974a7ae-8f19-4a59-856f-590454ca022d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2974a7ae-8f19-4a59-856f-590454ca022d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:02:58.752385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:02:58.753549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:02:58.754640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:02:58.754640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:02:58.754640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:02:58.754640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:02:58.754640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 606/1228] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 11 14:02:58.760693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc29a3-3759-44c6-94d1-9c91a3e442a3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:58.888220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc29a3-3759-44c6-94d1-9c91a3e442a3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:58.890846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:58.929326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0d2d-fe61-4060-9bc8-a4fa90829634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:58.930029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0d2d-fe61-4060-9bc8-a4fa90829634 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:58.930403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0d2d-fe61-4060-9bc8-a4fa90829634 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:58.930697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0d2d-fe61-4060-9bc8-a4fa90829634 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:58.931430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b0d2d-fe61-4060-9bc8-a4fa90829634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:58.931738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b0d2d-fe61-4060-9bc8-a4fa90829634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:58.933111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b0d2d-fe61-4060-9bc8-a4fa90829634 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:58.945778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 623/1229] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:58.951347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974a7ae-8f19-4a59-856f-590454ca022d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:58.961665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:59.070065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974a7ae-8f19-4a59-856f-590454ca022d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:59.110180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5537d0-1962-4632-b86d-de06e6d91e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:59.111011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5537d0-1962-4632-b86d-de06e6d91e0f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:59.111276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5537d0-1962-4632-b86d-de06e6d91e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:59.111715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5537d0-1962-4632-b86d-de06e6d91e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:59.118458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5537d0-1962-4632-b86d-de06e6d91e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:59.119905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5537d0-1962-4632-b86d-de06e6d91e0f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-ec5537d0-1962-4632-b86d-de06e6d91e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:02:59.134204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:02:59.135976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:02:59.137732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:02:59.137732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:02:59.137732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:02:59.137732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:02:59.137732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:02:59.137732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:02:59.137732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:02:59.137732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:02:59.137732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 607/1230] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:02:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:02:59.142112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0d2d-fe61-4060-9bc8-a4fa90829634 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:59.266444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0d2d-fe61-4060-9bc8-a4fa90829634 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:59.302075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f1f3a-e083-4b13-886c-597b78e9214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:59.302878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1f3a-e083-4b13-886c-597b78e9214f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:59.303173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1f3a-e083-4b13-886c-597b78e9214f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:59.303451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f1f3a-e083-4b13-886c-597b78e9214f None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:59.304261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f1f3a-e083-4b13-886c-597b78e9214f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:02:59.304833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f1f3a-e083-4b13-886c-597b78e9214f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:59.306602 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f1f3a-e083-4b13-886c-597b78e9214f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:59.324339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 624/1231] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:02:59.333707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5537d0-1962-4632-b86d-de06e6d91e0f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:02:59.418853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:02:59.460000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5537d0-1962-4632-b86d-de06e6d91e0f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:02:59.501894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186217df-c326-4aa1-9e5d-8ea32477c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:02:59.502906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186217df-c326-4aa1-9e5d-8ea32477c2ce None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:02:59.503200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186217df-c326-4aa1-9e5d-8ea32477c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:02:59.503544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186217df-c326-4aa1-9e5d-8ea32477c2ce None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/2949783e08504cfba3dc52dcf8b6a015/roles/2fe302f59f134744aaac6a31934efeea` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:02:59.521395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186217df-c326-4aa1-9e5d-8ea32477c2ce None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=2949783e08504cfba3dc52dcf8b6a015, role_id=2fe302f59f134744aaac6a31934efeea)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:02:59.523092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186217df-c326-4aa1-9e5d-8ea32477c2ce None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:02:59.536587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 608/1232] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:02:59 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/2949783e08504cfba3dc52dcf8b6a015/roles/2fe302f59f134744aaac6a31934efeea => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:03:01.779628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a65ab-d754-470d-b875-aecc8508737d None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:01.780230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a65ab-d754-470d-b875-aecc8508737d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:01.780230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a65ab-d754-470d-b875-aecc8508737d None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:01.781908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 625/1233] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:03:01.788051 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eebfc-b6f0-4d99-94e5-c69f1c822778 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:01.788514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eebfc-b6f0-4d99-94e5-c69f1c822778 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:01.788637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eebfc-b6f0-4d99-94e5-c69f1c822778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:01.807982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cb3eebfc-b6f0-4d99-94e5-c69f1c822778 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:03:01.809193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cb3eebfc-b6f0-4d99-94e5-c69f1c822778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:03:01.896442 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 609/1234] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:03:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:03:01.921616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a65ab-d754-470d-b875-aecc8508737d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:01.950236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:02.041884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a65ab-d754-470d-b875-aecc8508737d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:02.085117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746532-4f09-418f-90f2-ed0faff667c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:02.086026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746532-4f09-418f-90f2-ed0faff667c0 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:02.086453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746532-4f09-418f-90f2-ed0faff667c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:02.086853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746532-4f09-418f-90f2-ed0faff667c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:02.099226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2746532-4f09-418f-90f2-ed0faff667c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-e2746532-4f09-418f-90f2-ed0faff667c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:03:02.109128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:02.110447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:02.111408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 626/1235] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Jul 11 14:03:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:02.117000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eebfc-b6f0-4d99-94e5-c69f1c822778 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:02.166324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:02.226888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eebfc-b6f0-4d99-94e5-c69f1c822778 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:02.269202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd0e99-50fb-4f2e-9583-9cce665808da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:02.270204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd0e99-50fb-4f2e-9583-9cce665808da None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:02.270573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd0e99-50fb-4f2e-9583-9cce665808da None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:02.270896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd0e99-50fb-4f2e-9583-9cce665808da None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:02.271724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd0e99-50fb-4f2e-9583-9cce665808da None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:02.272102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd0e99-50fb-4f2e-9583-9cce665808da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:02.273664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd0e99-50fb-4f2e-9583-9cce665808da None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:02.284083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 610/1236] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Jul 11 14:03:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:02.290779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746532-4f09-418f-90f2-ed0faff667c0 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:02.398705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:02.417359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746532-4f09-418f-90f2-ed0faff667c0 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:02.470905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45af0-6539-4304-8182-10005264208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:02.471710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45af0-6539-4304-8182-10005264208a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:02.472006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45af0-6539-4304-8182-10005264208a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:02.472295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f45af0-6539-4304-8182-10005264208a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:02.485594 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f45af0-6539-4304-8182-10005264208a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:02.487220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f45af0-6539-4304-8182-10005264208a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-c1f45af0-6539-4304-8182-10005264208a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:03:02.507547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:02.508721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:02.515242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:03:02.515242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:03:02.515242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:02.515242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:02.515242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 627/1237] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:02.515590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd0e99-50fb-4f2e-9583-9cce665808da None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:02.627774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd0e99-50fb-4f2e-9583-9cce665808da None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:02.646807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:02.677937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f30880-4e37-4ba6-a429-9bdc14762e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:02.678567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30880-4e37-4ba6-a429-9bdc14762e55 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:02.678848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30880-4e37-4ba6-a429-9bdc14762e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:02.679120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f30880-4e37-4ba6-a429-9bdc14762e55 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:02.680020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f30880-4e37-4ba6-a429-9bdc14762e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:02.680326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f30880-4e37-4ba6-a429-9bdc14762e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:02.681957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f30880-4e37-4ba6-a429-9bdc14762e55 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:02.702971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 611/1238] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:03:02.704194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45af0-6539-4304-8182-10005264208a None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:02.817441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f45af0-6539-4304-8182-10005264208a None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:02.857752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0d114-9122-4c1a-9643-f500a814c1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:02.859318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0d114-9122-4c1a-9643-f500a814c1ec None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:02.859612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0d114-9122-4c1a-9643-f500a814c1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:02.859894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0d114-9122-4c1a-9643-f500a814c1ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:02.863152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:02.868829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0d114-9122-4c1a-9643-f500a814c1ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:02.870621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0d114-9122-4c1a-9643-f500a814c1ec None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-b7a0d114-9122-4c1a-9643-f500a814c1ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:03:02.888365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:02.890209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:02.891738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:02.891738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:02.891738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:03:02.891738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:03:02.891738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:03:02.891738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:03:02.891738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:03:02.891738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:03:02.891738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:03:02.891738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:02.891738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 628/1239] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:02.897270 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f30880-4e37-4ba6-a429-9bdc14762e55 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:03.039398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f30880-4e37-4ba6-a429-9bdc14762e55 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:03.084012 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8433d2-ba40-4569-b5d2-e49013751709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:03.084887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8433d2-ba40-4569-b5d2-e49013751709 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:03.085264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8433d2-ba40-4569-b5d2-e49013751709 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:03.085610 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8433d2-ba40-4569-b5d2-e49013751709 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:03.087573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8433d2-ba40-4569-b5d2-e49013751709 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:03.087573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8433d2-ba40-4569-b5d2-e49013751709 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:03.088692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8433d2-ba40-4569-b5d2-e49013751709 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:03.111516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 612/1240] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 11 14:03:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:03.117486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0d114-9122-4c1a-9643-f500a814c1ec None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:03.237849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0d114-9122-4c1a-9643-f500a814c1ec None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:03.278996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7b05b-a8b4-48df-83ef-f06e1357d626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:03.279750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7b05b-a8b4-48df-83ef-f06e1357d626 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:03.280696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7b05b-a8b4-48df-83ef-f06e1357d626 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:03.281189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7b05b-a8b4-48df-83ef-f06e1357d626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:03.349544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:03.359506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7b05b-a8b4-48df-83ef-f06e1357d626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:03.360974 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7b05b-a8b4-48df-83ef-f06e1357d626 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:03.475968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 629/1241] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:03:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:03:03.482392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8433d2-ba40-4569-b5d2-e49013751709 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:03.515552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:03.596482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8433d2-ba40-4569-b5d2-e49013751709 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:03.637956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d0e88-5abe-4afd-b9ba-dd4f300bbd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:03.638887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d0e88-5abe-4afd-b9ba-dd4f300bbd1d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:03.639783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d0e88-5abe-4afd-b9ba-dd4f300bbd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:03.640149 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d0e88-5abe-4afd-b9ba-dd4f300bbd1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:03.658237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d0e88-5abe-4afd-b9ba-dd4f300bbd1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:03.660182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d0e88-5abe-4afd-b9ba-dd4f300bbd1d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6d7d0e88-5abe-4afd-b9ba-dd4f300bbd1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:03:03.683352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:03.684490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:03.690861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:03:03.690861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:03:03.690861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:03.690861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:03.690861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 613/1242] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:03.691286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7b05b-a8b4-48df-83ef-f06e1357d626 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:03.804397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:03.811026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7b05b-a8b4-48df-83ef-f06e1357d626 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:03.853837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c489d-b41d-476b-901b-056ad75b3c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:03.854608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c489d-b41d-476b-901b-056ad75b3c84 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:03.854887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c489d-b41d-476b-901b-056ad75b3c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:03.855217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c489d-b41d-476b-901b-056ad75b3c84 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:03.855962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c489d-b41d-476b-901b-056ad75b3c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:03.856315 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c489d-b41d-476b-901b-056ad75b3c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:03.857747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c489d-b41d-476b-901b-056ad75b3c84 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:03.870431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 630/1243] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:03.877587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d0e88-5abe-4afd-b9ba-dd4f300bbd1d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:03.972676 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:03.996845 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d0e88-5abe-4afd-b9ba-dd4f300bbd1d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:04.037442 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3e78b-ad92-429e-96d2-b85d564447f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:04.038371 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3e78b-ad92-429e-96d2-b85d564447f7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:04.038661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3e78b-ad92-429e-96d2-b85d564447f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:04.038940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3e78b-ad92-429e-96d2-b85d564447f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:04.045827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3e78b-ad92-429e-96d2-b85d564447f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:04.047326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3e78b-ad92-429e-96d2-b85d564447f7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-25a3e78b-ad92-429e-96d2-b85d564447f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:03:04.064518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:04.065662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:04.066807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:03:04.066807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:03:04.066807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:03:04.066807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:03:04.066807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:03:04.066807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:03:04.066807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:03:04.066807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:04.066807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 614/1244] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:04.072805 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c489d-b41d-476b-901b-056ad75b3c84 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:04.188885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c489d-b41d-476b-901b-056ad75b3c84 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:04.234555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be7644-89b4-4999-97f6-9e43c8001e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:04.235340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be7644-89b4-4999-97f6-9e43c8001e83 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:04.235576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be7644-89b4-4999-97f6-9e43c8001e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:04.235925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be7644-89b4-4999-97f6-9e43c8001e83 None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:04.236828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be7644-89b4-4999-97f6-9e43c8001e83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:04.237218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be7644-89b4-4999-97f6-9e43c8001e83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:04.239082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be7644-89b4-4999-97f6-9e43c8001e83 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:04.254638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 631/1245] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:04.261755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3e78b-ad92-429e-96d2-b85d564447f7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:04.377396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3e78b-ad92-429e-96d2-b85d564447f7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:04.419146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582c328-2791-457d-bc62-f683a6d23a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:04.419959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582c328-2791-457d-bc62-f683a6d23a0b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:04.420902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582c328-2791-457d-bc62-f683a6d23a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:04.421262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582c328-2791-457d-bc62-f683a6d23a0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:04.422442 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582c328-2791-457d-bc62-f683a6d23a0b None admin] RBAC: Adding query filter params (role.id=2fe302f59f134744aaac6a31934efeea, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=2949783e08504cfba3dc52dcf8b6a015) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:04.422738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582c328-2791-457d-bc62-f683a6d23a0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:04.424572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582c328-2791-457d-bc62-f683a6d23a0b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:04.432024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 615/1246] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:03:04 2022] GET /identity/v3/role_assignments?user.id=2949783e08504cfba3dc52dcf8b6a015&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=2fe302f59f134744aaac6a31934efeea => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:06.774798 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91508e0-267f-4463-99f3-1539623dd6ec None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:06.775456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91508e0-267f-4463-99f3-1539623dd6ec None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:06.775991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91508e0-267f-4463-99f3-1539623dd6ec None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:06.777858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 632/1247] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:03:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:03:06.789826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3cd1a-b395-4498-a83f-e18ad231a13d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:06.791296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3cd1a-b395-4498-a83f-e18ad231a13d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:06.791769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3cd1a-b395-4498-a83f-e18ad231a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:06.799159 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:06.821065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-36c3cd1a-b395-4498-a83f-e18ad231a13d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:03:06.822887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-36c3cd1a-b395-4498-a83f-e18ad231a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:03:06.922194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 616/1248] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:03:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:03:06.941014 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91508e0-267f-4463-99f3-1539623dd6ec None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:06.962151 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:07.067214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91508e0-267f-4463-99f3-1539623dd6ec None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:07.109684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef2169-cf5e-4d06-9da4-7852b3c53623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:07.110568 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef2169-cf5e-4d06-9da4-7852b3c53623 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:07.110948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef2169-cf5e-4d06-9da4-7852b3c53623 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:07.111240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef2169-cf5e-4d06-9da4-7852b3c53623 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:07.122787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef2169-cf5e-4d06-9da4-7852b3c53623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-71ef2169-cf5e-4d06-9da4-7852b3c53623 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:03:07.132490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:07.133612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:07.134580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 633/1249] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:03:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:07.141232 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3cd1a-b395-4498-a83f-e18ad231a13d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:07.254352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3cd1a-b395-4498-a83f-e18ad231a13d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:07.287985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:07.293923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ce462-baec-44d2-85b8-208e387da28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:07.294644 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ce462-baec-44d2-85b8-208e387da28a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:07.294934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ce462-baec-44d2-85b8-208e387da28a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:07.295211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ce462-baec-44d2-85b8-208e387da28a None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:07.295959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ce462-baec-44d2-85b8-208e387da28a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:07.296269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ce462-baec-44d2-85b8-208e387da28a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:07.297689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ce462-baec-44d2-85b8-208e387da28a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:07.306962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 617/1250] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:03:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:07.313236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef2169-cf5e-4d06-9da4-7852b3c53623 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:07.403637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:07.431104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef2169-cf5e-4d06-9da4-7852b3c53623 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:07.469935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77a68-e79f-4d4b-a263-e49e99cbdba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:07.470916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77a68-e79f-4d4b-a263-e49e99cbdba7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:07.471271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77a68-e79f-4d4b-a263-e49e99cbdba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:07.471655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab77a68-e79f-4d4b-a263-e49e99cbdba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:07.483951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab77a68-e79f-4d4b-a263-e49e99cbdba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:07.485652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab77a68-e79f-4d4b-a263-e49e99cbdba7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-dab77a68-e79f-4d4b-a263-e49e99cbdba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:03:07.515033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:07.516307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:07.517618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:03:07.517618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:03:07.517618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:07.517618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:07.517618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 634/1251] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:07.522622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ce462-baec-44d2-85b8-208e387da28a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:07.635519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ce462-baec-44d2-85b8-208e387da28a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:07.672434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68286730-8381-4b7b-af84-bc49a1590cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:07.673061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68286730-8381-4b7b-af84-bc49a1590cda None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:07.673444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68286730-8381-4b7b-af84-bc49a1590cda None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:07.673702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68286730-8381-4b7b-af84-bc49a1590cda None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:07.674486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68286730-8381-4b7b-af84-bc49a1590cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:07.674794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68286730-8381-4b7b-af84-bc49a1590cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:07.676158 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68286730-8381-4b7b-af84-bc49a1590cda None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:07.688642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 618/1252] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:07.694235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77a68-e79f-4d4b-a263-e49e99cbdba7 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:07.808772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab77a68-e79f-4d4b-a263-e49e99cbdba7 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:07.844711 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:07.854505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ef630-904d-4fa0-93a0-1448dece0ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:07.855370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ef630-904d-4fa0-93a0-1448dece0ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:07.855660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ef630-904d-4fa0-93a0-1448dece0ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:07.855939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ef630-904d-4fa0-93a0-1448dece0ae8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:07.865180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ef630-904d-4fa0-93a0-1448dece0ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:07.867242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ef630-904d-4fa0-93a0-1448dece0ae8 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-bf7ef630-904d-4fa0-93a0-1448dece0ae8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:03:07.884719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:07.885936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:07.886963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:07.886963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:07.886963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:03:07.886963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:03:07.886963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:03:07.886963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:03:07.886963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:03:07.886963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:03:07.886963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:03:07.886963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:07.886963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 635/1253] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:07.893253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68286730-8381-4b7b-af84-bc49a1590cda None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:07.954046 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:08.000203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68286730-8381-4b7b-af84-bc49a1590cda None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:08.038807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc5e9a-3b9b-4f0f-af63-ddab2550cb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:08.039623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc5e9a-3b9b-4f0f-af63-ddab2550cb95 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:08.039984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc5e9a-3b9b-4f0f-af63-ddab2550cb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:08.040296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc5e9a-3b9b-4f0f-af63-ddab2550cb95 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:08.041360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc5e9a-3b9b-4f0f-af63-ddab2550cb95 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:08.041736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc5e9a-3b9b-4f0f-af63-ddab2550cb95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:08.043470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc5e9a-3b9b-4f0f-af63-ddab2550cb95 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:08.064594 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 619/1254] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 11 14:03:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:08.070374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ef630-904d-4fa0-93a0-1448dece0ae8 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:08.187932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ef630-904d-4fa0-93a0-1448dece0ae8 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:08.229799 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190ffac-3836-40b6-b7be-771921d24512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:08.230497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ffac-3836-40b6-b7be-771921d24512 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:08.230791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ffac-3836-40b6-b7be-771921d24512 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:08.231076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190ffac-3836-40b6-b7be-771921d24512 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:08.298771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:08.316438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190ffac-3836-40b6-b7be-771921d24512 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:08.318364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190ffac-3836-40b6-b7be-771921d24512 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:08.436874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 636/1255] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:03:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:03:08.442641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc5e9a-3b9b-4f0f-af63-ddab2550cb95 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:08.553999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc5e9a-3b9b-4f0f-af63-ddab2550cb95 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:08.568782 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:08.594716 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcbbce-8c82-448e-bffe-1f9d317216c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:08.595519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcbbce-8c82-448e-bffe-1f9d317216c7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:08.595799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcbbce-8c82-448e-bffe-1f9d317216c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:08.596072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcbbce-8c82-448e-bffe-1f9d317216c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:08.607687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcbbce-8c82-448e-bffe-1f9d317216c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:08.610007 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcbbce-8c82-448e-bffe-1f9d317216c7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-24bcbbce-8c82-448e-bffe-1f9d317216c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:03:08.629691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:08.630901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:08.636759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:03:08.636759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:03:08.636759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:08.636759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:08.636759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 620/1256] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:08.637191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190ffac-3836-40b6-b7be-771921d24512 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:08.729720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:08.743094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190ffac-3836-40b6-b7be-771921d24512 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:08.781932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c6032-724d-44d4-9573-63a659c3bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:08.782656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c6032-724d-44d4-9573-63a659c3bce6 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:08.782939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c6032-724d-44d4-9573-63a659c3bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:08.783215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c6032-724d-44d4-9573-63a659c3bce6 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:08.783946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c6032-724d-44d4-9573-63a659c3bce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:08.784251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c6032-724d-44d4-9573-63a659c3bce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:08.785641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c6032-724d-44d4-9573-63a659c3bce6 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:08.803132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 637/1257] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:08.804523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcbbce-8c82-448e-bffe-1f9d317216c7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:08.921473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcbbce-8c82-448e-bffe-1f9d317216c7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:08.957038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a115e-d86c-4a17-bbf9-4d8d82c8f4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:08.957827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a115e-d86c-4a17-bbf9-4d8d82c8f4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:08.958106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a115e-d86c-4a17-bbf9-4d8d82c8f4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:08.958413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a115e-d86c-4a17-bbf9-4d8d82c8f4e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:08.966198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a115e-d86c-4a17-bbf9-4d8d82c8f4e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:08.968279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a115e-d86c-4a17-bbf9-4d8d82c8f4e2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-000a115e-d86c-4a17-bbf9-4d8d82c8f4e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:03:08.982110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:08.983281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:08.984377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:03:08.984377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:03:08.984377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:03:08.984377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:03:08.984377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:03:08.984377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:03:08.984377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:03:08.984377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:08.984377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 621/1258] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:08.989522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c6032-724d-44d4-9573-63a659c3bce6 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:09.096961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c6032-724d-44d4-9573-63a659c3bce6 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:09.133256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45cd0-2085-4d9b-a6f4-2a5847f3432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:09.134007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45cd0-2085-4d9b-a6f4-2a5847f3432a None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:09.134317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45cd0-2085-4d9b-a6f4-2a5847f3432a None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:09.134597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45cd0-2085-4d9b-a6f4-2a5847f3432a None admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:09.135398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a45cd0-2085-4d9b-a6f4-2a5847f3432a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:09.135706 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a45cd0-2085-4d9b-a6f4-2a5847f3432a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:09.137145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a45cd0-2085-4d9b-a6f4-2a5847f3432a None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:09.150721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 638/1259] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:09.156664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a115e-d86c-4a17-bbf9-4d8d82c8f4e2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:09.182180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:09.256109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a115e-d86c-4a17-bbf9-4d8d82c8f4e2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:09.288778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8659ff-b8dc-40d5-8f32-e333209eb1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:09.289426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8659ff-b8dc-40d5-8f32-e333209eb1ee None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:09.289706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8659ff-b8dc-40d5-8f32-e333209eb1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:09.289978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8659ff-b8dc-40d5-8f32-e333209eb1ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:09.290829 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8659ff-b8dc-40d5-8f32-e333209eb1ee None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=2949783e08504cfba3dc52dcf8b6a015) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:09.291138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8659ff-b8dc-40d5-8f32-e333209eb1ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:09.292553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8659ff-b8dc-40d5-8f32-e333209eb1ee None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:09.298018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 622/1260] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:03:09 2022] GET /identity/v3/role_assignments?user.id=2949783e08504cfba3dc52dcf8b6a015&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=57f1335a97b5490cb0853894c2faf62c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:11.288346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26802cbf-d7e1-44b4-b485-1f5d227bc73c None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:11.288855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26802cbf-d7e1-44b4-b485-1f5d227bc73c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:11.288982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26802cbf-d7e1-44b4-b485-1f5d227bc73c None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:11.290313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 639/1261] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:03:11.295760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d9da3-acbe-44f1-9531-20d351842f2c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:11.296169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d9da3-acbe-44f1-9531-20d351842f2c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:11.296327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d9da3-acbe-44f1-9531-20d351842f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:11.312662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-848d9da3-acbe-44f1-9531-20d351842f2c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:03:11.313858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-848d9da3-acbe-44f1-9531-20d351842f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:03:11.381458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 623/1262] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:03:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:03:11.404940 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26802cbf-d7e1-44b4-b485-1f5d227bc73c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:11.415921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:11.505189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26802cbf-d7e1-44b4-b485-1f5d227bc73c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:11.538722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133390b8-f5b6-4462-ac4b-ec70b2a4edf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:11.539505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133390b8-f5b6-4462-ac4b-ec70b2a4edf2 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:11.539793 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133390b8-f5b6-4462-ac4b-ec70b2a4edf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:11.540074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133390b8-f5b6-4462-ac4b-ec70b2a4edf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:11.550606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133390b8-f5b6-4462-ac4b-ec70b2a4edf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-133390b8-f5b6-4462-ac4b-ec70b2a4edf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:03:11.558123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:11.559578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:11.560517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 640/1263] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:03:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:11.565493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d9da3-acbe-44f1-9531-20d351842f2c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:11.584188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:11.664371 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d9da3-acbe-44f1-9531-20d351842f2c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:11.697566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9542401-0b55-4906-b254-f41a4bccbd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:11.698260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9542401-0b55-4906-b254-f41a4bccbd8a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:11.698547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9542401-0b55-4906-b254-f41a4bccbd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:11.698816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9542401-0b55-4906-b254-f41a4bccbd8a None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:11.699551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9542401-0b55-4906-b254-f41a4bccbd8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:11.699860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9542401-0b55-4906-b254-f41a4bccbd8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:11.701276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9542401-0b55-4906-b254-f41a4bccbd8a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:11.709354 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 624/1264] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:03:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:11.715075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133390b8-f5b6-4462-ac4b-ec70b2a4edf2 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:11.782288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:11.815616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133390b8-f5b6-4462-ac4b-ec70b2a4edf2 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:11.857786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca9927-12d0-43cc-bb76-bc7656f8f98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:11.859033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9927-12d0-43cc-bb76-bc7656f8f98e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:11.859375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9927-12d0-43cc-bb76-bc7656f8f98e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:11.859709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca9927-12d0-43cc-bb76-bc7656f8f98e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:11.872486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca9927-12d0-43cc-bb76-bc7656f8f98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:11.874544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca9927-12d0-43cc-bb76-bc7656f8f98e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-adca9927-12d0-43cc-bb76-bc7656f8f98e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:03:11.897836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:11.899018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:11.900140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:03:11.900140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:03:11.900140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:11.900140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:11.900140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 641/1265] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:11.905212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9542401-0b55-4906-b254-f41a4bccbd8a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:11.985229 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:12.006138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9542401-0b55-4906-b254-f41a4bccbd8a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:12.040783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e26c04-85ba-4f5d-a3b4-872ed6b24980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:12.041359 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e26c04-85ba-4f5d-a3b4-872ed6b24980 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:12.041636 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e26c04-85ba-4f5d-a3b4-872ed6b24980 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:12.041907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e26c04-85ba-4f5d-a3b4-872ed6b24980 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:12.042653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e26c04-85ba-4f5d-a3b4-872ed6b24980 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:12.042958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e26c04-85ba-4f5d-a3b4-872ed6b24980 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:12.044499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e26c04-85ba-4f5d-a3b4-872ed6b24980 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:12.056764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 625/1266] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:12.062563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca9927-12d0-43cc-bb76-bc7656f8f98e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:12.163393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca9927-12d0-43cc-bb76-bc7656f8f98e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:12.182379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:12.197307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c282c-8e07-49cc-a58a-4be996ef920b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:12.198121 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c282c-8e07-49cc-a58a-4be996ef920b None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:12.198438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c282c-8e07-49cc-a58a-4be996ef920b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:12.198717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c282c-8e07-49cc-a58a-4be996ef920b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:12.207269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c282c-8e07-49cc-a58a-4be996ef920b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:12.208718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c282c-8e07-49cc-a58a-4be996ef920b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-0a6c282c-8e07-49cc-a58a-4be996ef920b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:03:12.224595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:12.225816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:12.227050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:12.227050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:12.227050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:03:12.227050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:03:12.227050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:03:12.227050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:03:12.227050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:03:12.227050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:03:12.227050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:03:12.227050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:12.227050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 642/1267] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:12.231532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e26c04-85ba-4f5d-a3b4-872ed6b24980 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:12.329702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e26c04-85ba-4f5d-a3b4-872ed6b24980 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:12.362990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f2893-bdbb-4cfb-aae7-6ded973135f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:12.363659 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f2893-bdbb-4cfb-aae7-6ded973135f9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:12.363939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f2893-bdbb-4cfb-aae7-6ded973135f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:12.364218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f2893-bdbb-4cfb-aae7-6ded973135f9 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:12.365054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f2893-bdbb-4cfb-aae7-6ded973135f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:12.365366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f2893-bdbb-4cfb-aae7-6ded973135f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:12.366827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f2893-bdbb-4cfb-aae7-6ded973135f9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:12.377382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:12.387068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 626/1268] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 11 14:03:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:12.393876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c282c-8e07-49cc-a58a-4be996ef920b None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:12.491899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c282c-8e07-49cc-a58a-4be996ef920b None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:12.525519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2da39-dc33-4986-a090-94f263298f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:12.526333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2da39-dc33-4986-a090-94f263298f65 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:12.526622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2da39-dc33-4986-a090-94f263298f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:12.526903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2da39-dc33-4986-a090-94f263298f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:12.537561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2da39-dc33-4986-a090-94f263298f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:12.539047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2da39-dc33-4986-a090-94f263298f65 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-82b2da39-dc33-4986-a090-94f263298f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:03:12.564130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:12.565291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:12.566403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:03:12.566403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:03:12.566403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:12.566403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:12.566403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 643/1269] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:12.571615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f2893-bdbb-4cfb-aae7-6ded973135f9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:12.670609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f2893-bdbb-4cfb-aae7-6ded973135f9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:12.704831 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88573da-553e-497b-aac3-caf81cd2e84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:12.705495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88573da-553e-497b-aac3-caf81cd2e84e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:12.705778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88573da-553e-497b-aac3-caf81cd2e84e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:12.706052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88573da-553e-497b-aac3-caf81cd2e84e None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:12.706815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88573da-553e-497b-aac3-caf81cd2e84e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:12.707115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88573da-553e-497b-aac3-caf81cd2e84e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:12.708481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88573da-553e-497b-aac3-caf81cd2e84e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:12.719655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 627/1270] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:12.725428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2da39-dc33-4986-a090-94f263298f65 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:12.756931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:12.829914 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2da39-dc33-4986-a090-94f263298f65 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:12.864837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86981b-5745-485d-ba66-62b620b77e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:12.865640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86981b-5745-485d-ba66-62b620b77e06 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:12.865928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86981b-5745-485d-ba66-62b620b77e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:12.866231 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86981b-5745-485d-ba66-62b620b77e06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:12.872791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86981b-5745-485d-ba66-62b620b77e06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:12.875125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86981b-5745-485d-ba66-62b620b77e06 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-ea86981b-5745-485d-ba66-62b620b77e06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:03:12.889638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:12.890802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:12.891784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:03:12.891784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:03:12.891784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:03:12.891784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:03:12.891784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:03:12.891784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:03:12.891784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:03:12.891784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:12.891784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 644/1271] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:12.897016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88573da-553e-497b-aac3-caf81cd2e84e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:12.964013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:13.007532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88573da-553e-497b-aac3-caf81cd2e84e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:13.041358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c7a75-70ac-41f3-8967-e14739ac7658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:13.042077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c7a75-70ac-41f3-8967-e14739ac7658 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:13.042395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c7a75-70ac-41f3-8967-e14739ac7658 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:13.042676 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c7a75-70ac-41f3-8967-e14739ac7658 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:13.043463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c7a75-70ac-41f3-8967-e14739ac7658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:13.043774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c7a75-70ac-41f3-8967-e14739ac7658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:13.045340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c7a75-70ac-41f3-8967-e14739ac7658 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:13.057686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 628/1272] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:03:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:13.063700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86981b-5745-485d-ba66-62b620b77e06 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:13.153299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:13.163478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86981b-5745-485d-ba66-62b620b77e06 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:13.198611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ef059-7f96-4d62-a736-bc2f4a6f148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:13.199516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ef059-7f96-4d62-a736-bc2f4a6f148b None admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:13.199820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ef059-7f96-4d62-a736-bc2f4a6f148b None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:13.200085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ef059-7f96-4d62-a736-bc2f4a6f148b None admin] PATH_INFO: `/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/2949783e08504cfba3dc52dcf8b6a015/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:13.202101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ef059-7f96-4d62-a736-bc2f4a6f148b None admin] RBAC: Authorizing `identity:create_grant(project_id=c1a77332a2b04ef881cf6e03226618ee, user_id=2949783e08504cfba3dc52dcf8b6a015, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:13.203564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ef059-7f96-4d62-a736-bc2f4a6f148b None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:13.220614 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 645/1273] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Jul 11 14:03:13 2022] PUT /identity/v3/projects/c1a77332a2b04ef881cf6e03226618ee/users/2949783e08504cfba3dc52dcf8b6a015/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:03:15.296272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ffe1d-f19c-47e3-9f4d-096e28c91ce6 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:15.296793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ffe1d-f19c-47e3-9f4d-096e28c91ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:15.296793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ffe1d-f19c-47e3-9f4d-096e28c91ce6 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:15.298200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 629/1274] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:03:15.303590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9902f8-e685-4b58-bd3d-6da3d2f082e5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:15.304046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9902f8-e685-4b58-bd3d-6da3d2f082e5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:15.304148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9902f8-e685-4b58-bd3d-6da3d2f082e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:15.320963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5e9902f8-e685-4b58-bd3d-6da3d2f082e5 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:03:15.322194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5e9902f8-e685-4b58-bd3d-6da3d2f082e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:03:15.388008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 646/1275] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:03:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:03:15.411882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ffe1d-f19c-47e3-9f4d-096e28c91ce6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:15.510923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ffe1d-f19c-47e3-9f4d-096e28c91ce6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:15.528183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:15.545185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66032ea8-66e2-47f9-bee3-a5baaea34071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:15.545956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032ea8-66e2-47f9-bee3-a5baaea34071 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:15.546265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032ea8-66e2-47f9-bee3-a5baaea34071 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:15.546542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66032ea8-66e2-47f9-bee3-a5baaea34071 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:15.556462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66032ea8-66e2-47f9-bee3-a5baaea34071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-66032ea8-66e2-47f9-bee3-a5baaea34071 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 11 14:03:15.564053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:15.565186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:15.566459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 630/1276] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Jul 11 14:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:15.571211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9902f8-e685-4b58-bd3d-6da3d2f082e5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:15.651497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:15.670625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9902f8-e685-4b58-bd3d-6da3d2f082e5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:15.703414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6eb5-a382-4691-9b51-3f233971233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:15.704085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6eb5-a382-4691-9b51-3f233971233e None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:15.704376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6eb5-a382-4691-9b51-3f233971233e None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:15.704660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e6eb5-a382-4691-9b51-3f233971233e None admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:15.705415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e6eb5-a382-4691-9b51-3f233971233e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:15.705728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e6eb5-a382-4691-9b51-3f233971233e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:15.707146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e6eb5-a382-4691-9b51-3f233971233e None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:15.715198 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 647/1277] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Jul 11 14:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:03:15.721483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66032ea8-66e2-47f9-bee3-a5baaea34071 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:15.818095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66032ea8-66e2-47f9-bee3-a5baaea34071 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:15.855627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aa3b8-8f82-45d9-a9c9-410408495ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:15.856429 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aa3b8-8f82-45d9-a9c9-410408495ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:15.856791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aa3b8-8f82-45d9-a9c9-410408495ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:15.857073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aa3b8-8f82-45d9-a9c9-410408495ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:15.868697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aa3b8-8f82-45d9-a9c9-410408495ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:15.870175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aa3b8-8f82-45d9-a9c9-410408495ea5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-388aa3b8-8f82-45d9-a9c9-410408495ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:03:15.889534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:15.890731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:15.891863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:03:15.891863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:03:15.891863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:15.891863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:15.891863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 631/1278] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:15.896820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6eb5-a382-4691-9b51-3f233971233e None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:15.996021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e6eb5-a382-4691-9b51-3f233971233e None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:16.029105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e944b-7101-4bcd-8fac-cd9f8b672272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:16.029761 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e944b-7101-4bcd-8fac-cd9f8b672272 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:16.030042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e944b-7101-4bcd-8fac-cd9f8b672272 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:16.030345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e944b-7101-4bcd-8fac-cd9f8b672272 None admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:16.031063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e944b-7101-4bcd-8fac-cd9f8b672272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:16.031367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e944b-7101-4bcd-8fac-cd9f8b672272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:16.032720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e944b-7101-4bcd-8fac-cd9f8b672272 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:16.045017 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 648/1279] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:16.050979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aa3b8-8f82-45d9-a9c9-410408495ea5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:16.082568 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:16.151738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aa3b8-8f82-45d9-a9c9-410408495ea5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:16.184230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7d187-90c8-482b-a817-7c6104efaa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:16.185029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7d187-90c8-482b-a817-7c6104efaa78 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:16.185870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7d187-90c8-482b-a817-7c6104efaa78 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:16.186133 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7d187-90c8-482b-a817-7c6104efaa78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:16.193649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7d187-90c8-482b-a817-7c6104efaa78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:16.195124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7d187-90c8-482b-a817-7c6104efaa78 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c4c7d187-90c8-482b-a817-7c6104efaa78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 11 14:03:16.211058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:16.212163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:16.213678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:16.213678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:16.213678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 11 14:03:16.213678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 11 14:03:16.213678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 11 14:03:16.213678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 11 14:03:16.213678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 11 14:03:16.213678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 11 14:03:16.213678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 11 14:03:16.213678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:16.213678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 632/1280] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:16.218734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e944b-7101-4bcd-8fac-cd9f8b672272 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:16.222665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:16.318778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e944b-7101-4bcd-8fac-cd9f8b672272 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:16.352984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc28b-4209-4ee0-9b43-68ebe230c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:16.353588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc28b-4209-4ee0-9b43-68ebe230c5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:16.353878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc28b-4209-4ee0-9b43-68ebe230c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:16.354178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc28b-4209-4ee0-9b43-68ebe230c5c7 None admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:16.355041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc28b-4209-4ee0-9b43-68ebe230c5c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:16.355355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc28b-4209-4ee0-9b43-68ebe230c5c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:16.356788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc28b-4209-4ee0-9b43-68ebe230c5c7 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:16.374814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 649/1281] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Jul 11 14:03:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:16.380798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7d187-90c8-482b-a817-7c6104efaa78 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:16.472010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:16.481908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7d187-90c8-482b-a817-7c6104efaa78 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:16.518535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40080b7-70c6-43e1-944b-97699710afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:16.519192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40080b7-70c6-43e1-944b-97699710afc5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:16.519479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40080b7-70c6-43e1-944b-97699710afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:16.519759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40080b7-70c6-43e1-944b-97699710afc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:16.586065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40080b7-70c6-43e1-944b-97699710afc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:16.587590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40080b7-70c6-43e1-944b-97699710afc5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:16.676717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:16.687443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 633/1282] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Jul 11 14:03:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 11 14:03:16.693238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc28b-4209-4ee0-9b43-68ebe230c5c7 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:16.755605 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:16.795539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc28b-4209-4ee0-9b43-68ebe230c5c7 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:16.829504 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ef9d0-d2ce-454a-929a-09a8e9d39635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:16.830319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ef9d0-d2ce-454a-929a-09a8e9d39635 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:16.830606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ef9d0-d2ce-454a-929a-09a8e9d39635 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:16.830882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ef9d0-d2ce-454a-929a-09a8e9d39635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:16.840662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ef9d0-d2ce-454a-929a-09a8e9d39635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:16.842713 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ef9d0-d2ce-454a-929a-09a8e9d39635 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-974ef9d0-d2ce-454a-929a-09a8e9d39635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 11 14:03:16.860209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:16.861307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:16.862498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 11 14:03:16.862498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 11 14:03:16.862498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 11 14:03:16.862498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:16.862498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 650/1283] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:16.867092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40080b7-70c6-43e1-944b-97699710afc5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:16.965410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40080b7-70c6-43e1-944b-97699710afc5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:16.999628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b0de3-5bf3-40a1-9a87-474efda376ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:17.000290 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0de3-5bf3-40a1-9a87-474efda376ba None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:17.000575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0de3-5bf3-40a1-9a87-474efda376ba None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:17.000855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0de3-5bf3-40a1-9a87-474efda376ba None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:17.001581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b0de3-5bf3-40a1-9a87-474efda376ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:17.001888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b0de3-5bf3-40a1-9a87-474efda376ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:17.003284 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b0de3-5bf3-40a1-9a87-474efda376ba None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:17.014745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 634/1284] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Jul 11 14:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:17.020837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ef9d0-d2ce-454a-929a-09a8e9d39635 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:17.117671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ef9d0-d2ce-454a-929a-09a8e9d39635 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:17.131391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:17.152222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f011d4-7753-4bad-a96e-0bb738f1ccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:17.153011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f011d4-7753-4bad-a96e-0bb738f1ccc3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:17.153298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f011d4-7753-4bad-a96e-0bb738f1ccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:17.153578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f011d4-7753-4bad-a96e-0bb738f1ccc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:17.160766 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f011d4-7753-4bad-a96e-0bb738f1ccc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:17.162243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f011d4-7753-4bad-a96e-0bb738f1ccc3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application [None req-59f011d4-7753-4bad-a96e-0bb738f1ccc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 11 14:03:17.175629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:17.176690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:17.177621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 11 14:03:17.177621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 11 14:03:17.177621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 11 14:03:17.177621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 11 14:03:17.177621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 11 14:03:17.177621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 11 14:03:17.177621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 11 14:03:17.177621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: ERROR keystone.server.flask.application Jul 11 14:03:17.177621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 651/1285] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Jul 11 14:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:17.182714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b0de3-5bf3-40a1-9a87-474efda376ba None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:17.233489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:17.284038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b0de3-5bf3-40a1-9a87-474efda376ba None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:17.316020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a1756-e8a1-4daa-8a3c-03d335cd6065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:17.316678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a1756-e8a1-4daa-8a3c-03d335cd6065 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:17.316965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a1756-e8a1-4daa-8a3c-03d335cd6065 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:17.317242 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a1756-e8a1-4daa-8a3c-03d335cd6065 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:17.318063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a1756-e8a1-4daa-8a3c-03d335cd6065 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:17.318409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a1756-e8a1-4daa-8a3c-03d335cd6065 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:17.319840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a1756-e8a1-4daa-8a3c-03d335cd6065 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:17.332483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 635/1286] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Jul 11 14:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:17.338680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f011d4-7753-4bad-a96e-0bb738f1ccc3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:17.439457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f011d4-7753-4bad-a96e-0bb738f1ccc3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:17.472673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50488b-f374-4441-bfe4-6ceb3d3c708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:17.473327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50488b-f374-4441-bfe4-6ceb3d3c708f None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:17.473614 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50488b-f374-4441-bfe4-6ceb3d3c708f None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:17.473896 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50488b-f374-4441-bfe4-6ceb3d3c708f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:17.474775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50488b-f374-4441-bfe4-6ceb3d3c708f None admin] RBAC: Adding query filter params (role.id=57f1335a97b5490cb0853894c2faf62c, scope.project.id=c1a77332a2b04ef881cf6e03226618ee, user.id=2949783e08504cfba3dc52dcf8b6a015) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:17.475091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50488b-f374-4441-bfe4-6ceb3d3c708f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:17.476530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50488b-f374-4441-bfe4-6ceb3d3c708f None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:17.482379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 652/1287] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Jul 11 14:03:17 2022] GET /identity/v3/role_assignments?user.id=2949783e08504cfba3dc52dcf8b6a015&scope.project.id=c1a77332a2b04ef881cf6e03226618ee&role.id=57f1335a97b5490cb0853894c2faf62c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:19.570062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6fa2a-81f5-464d-a288-d30f0954c5cd None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:19.570612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6fa2a-81f5-464d-a288-d30f0954c5cd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:19.570612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6fa2a-81f5-464d-a288-d30f0954c5cd None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:19.571916 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 636/1288] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:03:19.577676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d23f93-7e5d-4458-bd66-ea000bc1e111 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:19.578121 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d23f93-7e5d-4458-bd66-ea000bc1e111 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:19.578275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d23f93-7e5d-4458-bd66-ea000bc1e111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:19.595413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-48d23f93-7e5d-4458-bd66-ea000bc1e111 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:03:19.596616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-48d23f93-7e5d-4458-bd66-ea000bc1e111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:03:19.625776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:19.663285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 653/1289] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:03:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:03:19.685701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6fa2a-81f5-464d-a288-d30f0954c5cd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:19.786243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6fa2a-81f5-464d-a288-d30f0954c5cd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:19.796661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:19.821643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78aefd-795d-4923-b58d-c228c67f881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:19.821643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78aefd-795d-4923-b58d-c228c67f881b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:19.821954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78aefd-795d-4923-b58d-c228c67f881b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:19.821954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78aefd-795d-4923-b58d-c228c67f881b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:19.822626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78aefd-795d-4923-b58d-c228c67f881b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:19.824029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78aefd-795d-4923-b58d-c228c67f881b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7a78aefd-795d-4923-b58d-c228c67f881b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:19.837823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:19.839637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:19.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 637/1290] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 11 14:03:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:19.845524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d23f93-7e5d-4458-bd66-ea000bc1e111 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:19.952964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d23f93-7e5d-4458-bd66-ea000bc1e111 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:19.988440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d3f2b-4d67-4094-a582-db06029b40c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:19.989116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3f2b-4d67-4094-a582-db06029b40c4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:19.989404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3f2b-4d67-4094-a582-db06029b40c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:19.989685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3f2b-4d67-4094-a582-db06029b40c4 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:19.990501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3f2b-4d67-4094-a582-db06029b40c4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:19.990814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3f2b-4d67-4094-a582-db06029b40c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:19.992190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3f2b-4d67-4094-a582-db06029b40c4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:19.997117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 654/1291] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Jul 11 14:03:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:20.003384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78aefd-795d-4923-b58d-c228c67f881b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:20.100820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78aefd-795d-4923-b58d-c228c67f881b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:20.134475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb90057-887e-4c0d-b912-46b2b613bd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:20.135138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb90057-887e-4c0d-b912-46b2b613bd74 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:20.135424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb90057-887e-4c0d-b912-46b2b613bd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:20.135753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb90057-887e-4c0d-b912-46b2b613bd74 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:20.136409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb90057-887e-4c0d-b912-46b2b613bd74 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:20.136758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb90057-887e-4c0d-b912-46b2b613bd74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:20.138076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb90057-887e-4c0d-b912-46b2b613bd74 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:20.142961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 638/1292] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Jul 11 14:03:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:22.160634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34637a49-d0f3-4d70-b542-8dbce284d61f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:22.161215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34637a49-d0f3-4d70-b542-8dbce284d61f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:22.161215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34637a49-d0f3-4d70-b542-8dbce284d61f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:22.162647 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 655/1293] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:03:22.167612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ad5e-112e-476f-aece-47f027498ae9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:22.168034 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ad5e-112e-476f-aece-47f027498ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:22.168186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ad5e-112e-476f-aece-47f027498ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:22.184758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6bf5ad5e-112e-476f-aece-47f027498ae9 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:03:22.186702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6bf5ad5e-112e-476f-aece-47f027498ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:03:22.216655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:22.254263 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 639/1294] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:03:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:03:22.277516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34637a49-d0f3-4d70-b542-8dbce284d61f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:22.311309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:22.384471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34637a49-d0f3-4d70-b542-8dbce284d61f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:22.417915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920027b-2d85-4b89-9723-3dbfb53a3d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:22.418542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920027b-2d85-4b89-9723-3dbfb53a3d17 None admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:22.418829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920027b-2d85-4b89-9723-3dbfb53a3d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:22.419107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920027b-2d85-4b89-9723-3dbfb53a3d17 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:22.420424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920027b-2d85-4b89-9723-3dbfb53a3d17 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:22.421782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920027b-2d85-4b89-9723-3dbfb53a3d17 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:22.434521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 656/1295] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Jul 11 14:03:22 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:03:24.462307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069bfc2-3488-44e1-bcfb-7d2b68666a0d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:24.462872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069bfc2-3488-44e1-bcfb-7d2b68666a0d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:24.462872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069bfc2-3488-44e1-bcfb-7d2b68666a0d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:24.464292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 640/1296] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:03:24.469761 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27550-388b-40c9-bfab-8d8d162e1dff None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:24.470236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27550-388b-40c9-bfab-8d8d162e1dff None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:24.470342 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc27550-388b-40c9-bfab-8d8d162e1dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:24.487522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-bfc27550-388b-40c9-bfab-8d8d162e1dff None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:03:24.488733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-bfc27550-388b-40c9-bfab-8d8d162e1dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:03:24.559703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 657/1297] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:03:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:03:24.582992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069bfc2-3488-44e1-bcfb-7d2b68666a0d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:24.682385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069bfc2-3488-44e1-bcfb-7d2b68666a0d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:24.715029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eef564-8739-4b93-af3e-bd5db02e7557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:24.715753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef564-8739-4b93-af3e-bd5db02e7557 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:24.716043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef564-8739-4b93-af3e-bd5db02e7557 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:24.717253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eef564-8739-4b93-af3e-bd5db02e7557 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:24.717582 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eef564-8739-4b93-af3e-bd5db02e7557 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:24.718973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eef564-8739-4b93-af3e-bd5db02e7557 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-15eef564-8739-4b93-af3e-bd5db02e7557 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:24.730418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:24.731590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:24.733064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 641/1298] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 11 14:03:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:24.737714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc27550-388b-40c9-bfab-8d8d162e1dff None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:24.755994 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:24.837330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc27550-388b-40c9-bfab-8d8d162e1dff None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:24.871548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56eb6b-ad7d-4d63-a50e-68f7a7cc78e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:24.872229 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56eb6b-ad7d-4d63-a50e-68f7a7cc78e3 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:24.873091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56eb6b-ad7d-4d63-a50e-68f7a7cc78e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:24.873376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56eb6b-ad7d-4d63-a50e-68f7a7cc78e3 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:24.874095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56eb6b-ad7d-4d63-a50e-68f7a7cc78e3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:24.874440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56eb6b-ad7d-4d63-a50e-68f7a7cc78e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:24.875813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56eb6b-ad7d-4d63-a50e-68f7a7cc78e3 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:24.883610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 658/1299] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Jul 11 14:03:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:24.889550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eef564-8739-4b93-af3e-bd5db02e7557 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:24.921243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:24.987889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eef564-8739-4b93-af3e-bd5db02e7557 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:25.020226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43dabb-dc40-483d-b6e7-612fd62ce95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:25.020877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43dabb-dc40-483d-b6e7-612fd62ce95a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:25.021162 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43dabb-dc40-483d-b6e7-612fd62ce95a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:25.021441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43dabb-dc40-483d-b6e7-612fd62ce95a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:25.022264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43dabb-dc40-483d-b6e7-612fd62ce95a None admin] RBAC: Adding query filter params (interface=public, service_id=72e6a241a2234eca98ae934bca81f98c, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:25.022577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43dabb-dc40-483d-b6e7-612fd62ce95a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:25.023939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43dabb-dc40-483d-b6e7-612fd62ce95a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:25.029406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 642/1300] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Jul 11 14:03:24 2022] GET /identity/v3/endpoints?service_id=72e6a241a2234eca98ae934bca81f98c&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:25.035226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56eb6b-ad7d-4d63-a50e-68f7a7cc78e3 None admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:25.116064 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:25.134271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56eb6b-ad7d-4d63-a50e-68f7a7cc78e3 None admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:25.168912 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eac2e-b37e-49cc-977b-d3c5251aa3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:25.170307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eac2e-b37e-49cc-977b-d3c5251aa3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:25.170597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eac2e-b37e-49cc-977b-d3c5251aa3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:25.170876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eac2e-b37e-49cc-977b-d3c5251aa3a4 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:25.171564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eac2e-b37e-49cc-977b-d3c5251aa3a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:25.172939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eac2e-b37e-49cc-977b-d3c5251aa3a4 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:25.179700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 659/1301] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Jul 11 14:03:25 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:03:27.197009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8d632-faff-4bc8-97d6-512e06d56b8e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:27.197544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8d632-faff-4bc8-97d6-512e06d56b8e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:27.197663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8d632-faff-4bc8-97d6-512e06d56b8e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:27.198986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 643/1302] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:03:27.204886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31c01-80ca-44d1-b964-a090fa6ed048 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:27.205331 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31c01-80ca-44d1-b964-a090fa6ed048 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:27.205424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce31c01-80ca-44d1-b964-a090fa6ed048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:27.222012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4ce31c01-80ca-44d1-b964-a090fa6ed048 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:03:27.223220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4ce31c01-80ca-44d1-b964-a090fa6ed048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:03:27.287638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 660/1303] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:03:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 11 14:03:27.310816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8d632-faff-4bc8-97d6-512e06d56b8e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:27.404251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:27.411165 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8d632-faff-4bc8-97d6-512e06d56b8e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:27.446089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521cf90-0cbd-4293-9156-57d60651fe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:27.446951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521cf90-0cbd-4293-9156-57d60651fe85 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:27.447303 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521cf90-0cbd-4293-9156-57d60651fe85 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:27.447539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521cf90-0cbd-4293-9156-57d60651fe85 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:27.448201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521cf90-0cbd-4293-9156-57d60651fe85 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:27.449589 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521cf90-0cbd-4293-9156-57d60651fe85 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7521cf90-0cbd-4293-9156-57d60651fe85 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 11 14:03:27.462135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 11 14:03:27.463399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Jul 11 14:03:27.464609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 644/1304] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Jul 11 14:03:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 11 14:03:27.469648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31c01-80ca-44d1-b964-a090fa6ed048 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:27.546753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:27.571221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce31c01-80ca-44d1-b964-a090fa6ed048 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:27.605369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622ff23-b1ff-48df-a39a-0b8bba71e7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:27.606035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622ff23-b1ff-48df-a39a-0b8bba71e7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:27.606356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622ff23-b1ff-48df-a39a-0b8bba71e7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:27.607592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622ff23-b1ff-48df-a39a-0b8bba71e7e9 None admin] PATH_INFO: `/v3/services` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:27.608306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622ff23-b1ff-48df-a39a-0b8bba71e7e9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:03:27.608691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622ff23-b1ff-48df-a39a-0b8bba71e7e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:27.610328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622ff23-b1ff-48df-a39a-0b8bba71e7e9 None admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:27.615934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 661/1305] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Jul 11 14:03:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:03:27.621677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521cf90-0cbd-4293-9156-57d60651fe85 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:03:27.722886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521cf90-0cbd-4293-9156-57d60651fe85 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:03:27.776550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97746aff-0a0b-48bc-8b20-54496d5049e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:03:27.777239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97746aff-0a0b-48bc-8b20-54496d5049e3 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:03:27.777522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97746aff-0a0b-48bc-8b20-54496d5049e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:03:27.777799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97746aff-0a0b-48bc-8b20-54496d5049e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:03:27.779227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97746aff-0a0b-48bc-8b20-54496d5049e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:03:27.780591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97746aff-0a0b-48bc-8b20-54496d5049e3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:03:27.800166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 645/1306] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Jul 11 14:03:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:03:37.612559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=30 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:03:37.795785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:32.126259 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047433-45ba-4d8c-98f5-f1912996ee72 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:32.127150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047433-45ba-4d8c-98f5-f1912996ee72 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:32.127592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047433-45ba-4d8c-98f5-f1912996ee72 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:32.130128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 662/1307] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:04:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:32.136727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b49ae4-2330-4c23-a846-984e36e86f72 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:32.137296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b49ae4-2330-4c23-a846-984e36e86f72 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:32.137586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b49ae4-2330-4c23-a846-984e36e86f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:32.267354 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-62b49ae4-2330-4c23-a846-984e36e86f72 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:32.268710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-62b49ae4-2330-4c23-a846-984e36e86f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:32.388454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 646/1308] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:04:32.442862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd66a1-fa60-4ef2-90b8-df7477209000 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:32.443257 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd66a1-fa60-4ef2-90b8-df7477209000 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:32.443617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd66a1-fa60-4ef2-90b8-df7477209000 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:32.445363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 663/1309] 10.222.0.66 () {54 vars in 964 bytes} [Mon Jul 11 14:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:32.451790 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e209b-719a-4b4c-86b2-ee429327257f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:32.452101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e209b-719a-4b4c-86b2-ee429327257f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:32.452372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e209b-719a-4b4c-86b2-ee429327257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:32.554056 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c84e209b-719a-4b4c-86b2-ee429327257f None None] MFA Rules not processed for user `4426582f945e4c90bf8debd2ecbd9769`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:32.555240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c84e209b-719a-4b4c-86b2-ee429327257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:32.578454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:32.655178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 647/1310] 10.222.0.66 () {58 vars in 1061 bytes} [Mon Jul 11 14:04:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:04:32.656001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd66a1-fa60-4ef2-90b8-df7477209000 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:04:32.657899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-aacd66a1-fa60-4ef2-90b8-df7477209000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:32.844982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd66a1-fa60-4ef2-90b8-df7477209000 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:04:32.934315 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4a3d8-b815-4007-9a86-dcdf8228d61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:04:32.935036 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a3d8-b815-4007-9a86-dcdf8228d61e service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:32.935336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a3d8-b815-4007-9a86-dcdf8228d61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:32.935616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a3d8-b815-4007-9a86-dcdf8228d61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:32.937422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-16b4a3d8-b815-4007-9a86-dcdf8228d61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:32.996662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:33.058862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4a3d8-b815-4007-9a86-dcdf8228d61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:04:33.060446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4a3d8-b815-4007-9a86-dcdf8228d61e service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:04:33.086541 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 664/1311] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:04:35.525504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb06e4-e153-4c58-9f86-18d6379862f6 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:35.526044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb06e4-e153-4c58-9f86-18d6379862f6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:35.526044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb06e4-e153-4c58-9f86-18d6379862f6 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:35.527438 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 648/1312] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:35.532636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d23f1-67e3-424d-88ca-bee15679871c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:35.533032 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d23f1-67e3-424d-88ca-bee15679871c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:35.533199 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d23f1-67e3-424d-88ca-bee15679871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:35.622458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-717d23f1-67e3-424d-88ca-bee15679871c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:35.623684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-717d23f1-67e3-424d-88ca-bee15679871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:35.723735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 665/1313] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:04:35.762302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb06e4-e153-4c58-9f86-18d6379862f6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:04:35.763841 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d0cb06e4-e153-4c58-9f86-18d6379862f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:35.867846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb06e4-e153-4c58-9f86-18d6379862f6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:04:35.943372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:35.946921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4186628-38c2-4ef1-893f-d5888fa69166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:04:35.947768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4186628-38c2-4ef1-893f-d5888fa69166 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:35.948496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4186628-38c2-4ef1-893f-d5888fa69166 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:35.949130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4186628-38c2-4ef1-893f-d5888fa69166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:35.951482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c4186628-38c2-4ef1-893f-d5888fa69166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:36.085174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4186628-38c2-4ef1-893f-d5888fa69166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:04:36.086764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4186628-38c2-4ef1-893f-d5888fa69166 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:04:36.108609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 649/1314] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:04:38.498779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32c324-d60a-4e8d-be7d-6230f243e584 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:38.499319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32c324-d60a-4e8d-be7d-6230f243e584 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:38.499319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32c324-d60a-4e8d-be7d-6230f243e584 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:38.500674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 666/1315] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:38.505740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac6a54-3d62-47fa-9790-c61c324e5a6d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:38.506196 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac6a54-3d62-47fa-9790-c61c324e5a6d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:38.506344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac6a54-3d62-47fa-9790-c61c324e5a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:38.572189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4bac6a54-3d62-47fa-9790-c61c324e5a6d None None] MFA Rules not processed for user `9aeaa5e28ef143efbeeae1af9fd653f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:38.573409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4bac6a54-3d62-47fa-9790-c61c324e5a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:38.626450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:38.672746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 650/1316] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:04:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:04:38.713842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32c324-d60a-4e8d-be7d-6230f243e584 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:04:38.715574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0a32c324-d60a-4e8d-be7d-6230f243e584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:38.725564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:38.820286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32c324-d60a-4e8d-be7d-6230f243e584 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:04:38.912148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfb0fb-818f-4dc2-91e0-90619d834f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:04:38.912954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfb0fb-818f-4dc2-91e0-90619d834f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:38.913382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfb0fb-818f-4dc2-91e0-90619d834f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:38.913776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfb0fb-818f-4dc2-91e0-90619d834f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:38.915785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b0bfb0fb-818f-4dc2-91e0-90619d834f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:38.977563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:39.025049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfb0fb-818f-4dc2-91e0-90619d834f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:04:39.026540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfb0fb-818f-4dc2-91e0-90619d834f5e service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:04:39.046765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 667/1317] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:04:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:04:41.797809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499007bb-0859-4fba-8b9c-56454af4747b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:41.798376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499007bb-0859-4fba-8b9c-56454af4747b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:41.798504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499007bb-0859-4fba-8b9c-56454af4747b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:41.799789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 651/1318] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:41.805376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419b10-c931-46ee-8d24-0397fb6425e6 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:41.805856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419b10-c931-46ee-8d24-0397fb6425e6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:41.806041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1419b10-c931-46ee-8d24-0397fb6425e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:41.874671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c1419b10-c931-46ee-8d24-0397fb6425e6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:41.875925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c1419b10-c931-46ee-8d24-0397fb6425e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:41.972582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 668/1319] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:04:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:04:42.012760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499007bb-0859-4fba-8b9c-56454af4747b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:04:42.014374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-499007bb-0859-4fba-8b9c-56454af4747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:42.120248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499007bb-0859-4fba-8b9c-56454af4747b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:04:42.191653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a24f1a-40fc-42ef-8514-b3843dd95cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:04:42.192299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a24f1a-40fc-42ef-8514-b3843dd95cdc service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:42.192580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a24f1a-40fc-42ef-8514-b3843dd95cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:42.192854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a24f1a-40fc-42ef-8514-b3843dd95cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:42.194565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-51a24f1a-40fc-42ef-8514-b3843dd95cdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:42.202635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:42.304480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a24f1a-40fc-42ef-8514-b3843dd95cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:04:42.306679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a24f1a-40fc-42ef-8514-b3843dd95cdc service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:04:42.326271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 652/1320] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:04:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:04:45.113643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5af15-b86d-4235-a9ff-d246ad284a38 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:45.114347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5af15-b86d-4235-a9ff-d246ad284a38 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:45.114347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5af15-b86d-4235-a9ff-d246ad284a38 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:45.115630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 669/1321] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:45.122294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583fdf-77cd-484a-847b-0dc7e7a26c35 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:45.122924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583fdf-77cd-484a-847b-0dc7e7a26c35 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:45.122924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66583fdf-77cd-484a-847b-0dc7e7a26c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:45.190999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-66583fdf-77cd-484a-847b-0dc7e7a26c35 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:45.192213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-66583fdf-77cd-484a-847b-0dc7e7a26c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:45.259053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:45.313496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 653/1322] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:04:45.350879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5af15-b86d-4235-a9ff-d246ad284a38 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:04:45.352494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-20b5af15-b86d-4235-a9ff-d246ad284a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:45.375056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:45.466310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5af15-b86d-4235-a9ff-d246ad284a38 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:04:45.547292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416f2f-723c-4e35-9ac1-ca1d92c99282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:04:45.547989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416f2f-723c-4e35-9ac1-ca1d92c99282 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:45.548279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416f2f-723c-4e35-9ac1-ca1d92c99282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:45.548559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416f2f-723c-4e35-9ac1-ca1d92c99282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:45.550431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f9416f2f-723c-4e35-9ac1-ca1d92c99282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:45.630941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:45.672542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9416f2f-723c-4e35-9ac1-ca1d92c99282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:04:45.673917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9416f2f-723c-4e35-9ac1-ca1d92c99282 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:04:45.693071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 670/1323] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:04:47.832145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc02288-fa4d-451b-ae69-e1f348ab8b40 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:47.832666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc02288-fa4d-451b-ae69-e1f348ab8b40 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:47.832772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc02288-fa4d-451b-ae69-e1f348ab8b40 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:47.834254 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 654/1324] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:47.839617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9af67a-e53f-4531-a1c1-8f001f22a2bc None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:47.840034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9af67a-e53f-4531-a1c1-8f001f22a2bc None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:47.840178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9af67a-e53f-4531-a1c1-8f001f22a2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:47.911612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2f9af67a-e53f-4531-a1c1-8f001f22a2bc None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:47.912853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2f9af67a-e53f-4531-a1c1-8f001f22a2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:48.012725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 671/1325] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:04:48.062240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce68d-2735-403d-beab-0f861cded3bf None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:48.062536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce68d-2735-403d-beab-0f861cded3bf None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:48.062816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce68d-2735-403d-beab-0f861cded3bf None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:48.064191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 655/1326] 10.222.0.66 () {54 vars in 964 bytes} [Mon Jul 11 14:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:48.070148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae097ed-f280-444d-bcee-585d58cca35c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:48.070536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae097ed-f280-444d-bcee-585d58cca35c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:48.070910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae097ed-f280-444d-bcee-585d58cca35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:48.104599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:48.149664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2ae097ed-f280-444d-bcee-585d58cca35c None None] MFA Rules not processed for user `4426582f945e4c90bf8debd2ecbd9769`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:48.151457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2ae097ed-f280-444d-bcee-585d58cca35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:48.232739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 672/1327] 10.222.0.66 () {58 vars in 1061 bytes} [Mon Jul 11 14:04:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:04:48.242048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ce68d-2735-403d-beab-0f861cded3bf None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:04:48.243673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fe8ce68d-2735-403d-beab-0f861cded3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:48.361450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ce68d-2735-403d-beab-0f861cded3bf None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:04:48.440351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ec28e-d98a-43c4-9925-c113c2fc3675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:04:48.441016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec28e-d98a-43c4-9925-c113c2fc3675 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:48.441296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec28e-d98a-43c4-9925-c113c2fc3675 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:48.441570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec28e-d98a-43c4-9925-c113c2fc3675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:48.443359 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-340ec28e-d98a-43c4-9925-c113c2fc3675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:48.463102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:48.568049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ec28e-d98a-43c4-9925-c113c2fc3675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:04:48.569509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ec28e-d98a-43c4-9925-c113c2fc3675 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:04:48.590398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 656/1328] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:04:50.927437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5343071-f7b8-485e-a18c-2c9ccc874cea None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:50.927966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5343071-f7b8-485e-a18c-2c9ccc874cea None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:50.927966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5343071-f7b8-485e-a18c-2c9ccc874cea None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:50.929505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 673/1329] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:50.935754 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3905da-81c6-41ff-9640-452d3a7b775c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:50.936211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3905da-81c6-41ff-9640-452d3a7b775c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:50.936441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3905da-81c6-41ff-9640-452d3a7b775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:51.007283 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7b3905da-81c6-41ff-9640-452d3a7b775c None None] MFA Rules not processed for user `9aeaa5e28ef143efbeeae1af9fd653f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:51.008511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7b3905da-81c6-41ff-9640-452d3a7b775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:51.075339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:51.110468 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 657/1330] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:04:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:04:51.157448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5343071-f7b8-485e-a18c-2c9ccc874cea None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:04:51.160423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c5343071-f7b8-485e-a18c-2c9ccc874cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:51.274543 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5343071-f7b8-485e-a18c-2c9ccc874cea None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:04:51.295987 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:51.349843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8c406-f436-44d7-8107-7f0621675b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:04:51.350540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c406-f436-44d7-8107-7f0621675b75 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:51.350835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c406-f436-44d7-8107-7f0621675b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:51.351114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8c406-f436-44d7-8107-7f0621675b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:51.353709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-84d8c406-f436-44d7-8107-7f0621675b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:51.470259 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8c406-f436-44d7-8107-7f0621675b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:04:51.471710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8c406-f436-44d7-8107-7f0621675b75 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:04:51.493373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 674/1331] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:04:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:04:53.987353 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8791fc-ae84-48bc-a972-dae71d563613 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:53.987936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8791fc-ae84-48bc-a972-dae71d563613 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:53.987936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8791fc-ae84-48bc-a972-dae71d563613 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:53.989287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 658/1332] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:53.994760 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de863-bf79-4b7c-bf6a-94c91720e083 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:53.995190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de863-bf79-4b7c-bf6a-94c91720e083 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:53.995334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de863-bf79-4b7c-bf6a-94c91720e083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:54.063852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:54.066982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5a2de863-bf79-4b7c-bf6a-94c91720e083 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:54.068514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5a2de863-bf79-4b7c-bf6a-94c91720e083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:54.168087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 675/1333] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:04:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:04:54.203524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8791fc-ae84-48bc-a972-dae71d563613 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:04:54.205054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ca8791fc-ae84-48bc-a972-dae71d563613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:54.310478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8791fc-ae84-48bc-a972-dae71d563613 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:04:54.392696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468618b8-5c2a-4b07-8bcd-527e7520d237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:04:54.393692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468618b8-5c2a-4b07-8bcd-527e7520d237 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:54.393984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468618b8-5c2a-4b07-8bcd-527e7520d237 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:54.394505 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468618b8-5c2a-4b07-8bcd-527e7520d237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:54.397408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-468618b8-5c2a-4b07-8bcd-527e7520d237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:54.426642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:54.515864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468618b8-5c2a-4b07-8bcd-527e7520d237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:04:54.517325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468618b8-5c2a-4b07-8bcd-527e7520d237 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:04:54.537552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 659/1334] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:04:56.686076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a54d3-2a97-4a15-997f-240a788984df None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:56.686665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a54d3-2a97-4a15-997f-240a788984df None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:56.686665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a54d3-2a97-4a15-997f-240a788984df None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:56.688058 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 676/1335] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:56.693253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318d84-7c23-4ee5-8bfb-4079dd2b8c2a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:56.693711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318d84-7c23-4ee5-8bfb-4079dd2b8c2a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:56.693828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318d84-7c23-4ee5-8bfb-4079dd2b8c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:56.759824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a9318d84-7c23-4ee5-8bfb-4079dd2b8c2a None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:56.761057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a9318d84-7c23-4ee5-8bfb-4079dd2b8c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:56.836380 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:56.859589 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 660/1336] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:04:56.901716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a54d3-2a97-4a15-997f-240a788984df None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:04:56.903258 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-af9a54d3-2a97-4a15-997f-240a788984df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:57.004648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a54d3-2a97-4a15-997f-240a788984df None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:04:57.033571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:57.082341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5744af-0c91-4d70-94c5-970b7b3a0620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:04:57.083016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5744af-0c91-4d70-94c5-970b7b3a0620 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:57.083316 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5744af-0c91-4d70-94c5-970b7b3a0620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:57.083594 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5744af-0c91-4d70-94c5-970b7b3a0620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:57.085282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ba5744af-0c91-4d70-94c5-970b7b3a0620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:57.194547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5744af-0c91-4d70-94c5-970b7b3a0620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:04:57.196112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5744af-0c91-4d70-94c5-970b7b3a0620 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:04:57.216019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 677/1337] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:04:59.587185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53939c74-7634-4a67-9a27-05a12563ddb3 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:59.588326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53939c74-7634-4a67-9a27-05a12563ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:59.588326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53939c74-7634-4a67-9a27-05a12563ddb3 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:59.589827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 661/1338] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:04:59.595611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1065cd-9711-40d1-bdf0-56a9e3617241 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:04:59.596077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1065cd-9711-40d1-bdf0-56a9e3617241 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:04:59.596177 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1065cd-9711-40d1-bdf0-56a9e3617241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:04:59.661988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-9d1065cd-9711-40d1-bdf0-56a9e3617241 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:04:59.663239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9d1065cd-9711-40d1-bdf0-56a9e3617241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:59.672070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:04:59.771142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 678/1339] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:04:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:04:59.807469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53939c74-7634-4a67-9a27-05a12563ddb3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:04:59.809014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-53939c74-7634-4a67-9a27-05a12563ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:04:59.922348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53939c74-7634-4a67-9a27-05a12563ddb3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:00.000468 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727e804-afed-47ea-8e95-7275fd693b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:00.001158 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727e804-afed-47ea-8e95-7275fd693b30 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:00.001504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727e804-afed-47ea-8e95-7275fd693b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:00.001797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727e804-afed-47ea-8e95-7275fd693b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:00.003652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d727e804-afed-47ea-8e95-7275fd693b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:00.043696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:00.117782 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727e804-afed-47ea-8e95-7275fd693b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:00.119301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727e804-afed-47ea-8e95-7275fd693b30 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:00.137264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 662/1340] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:04:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:04.287655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf405-0f82-4e2a-9cbf-6ac00f67fa16 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:04.288165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf405-0f82-4e2a-9cbf-6ac00f67fa16 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:04.288165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf405-0f82-4e2a-9cbf-6ac00f67fa16 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:04.289559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 679/1341] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:04.295685 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5b1c4-81c2-4f06-9ab8-ce675c583da9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:04.296125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5b1c4-81c2-4f06-9ab8-ce675c583da9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:04.296297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5b1c4-81c2-4f06-9ab8-ce675c583da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:04.363218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-99f5b1c4-81c2-4f06-9ab8-ce675c583da9 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:04.364399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-99f5b1c4-81c2-4f06-9ab8-ce675c583da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:04.458994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:04.472168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 663/1342] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:04.511848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdf405-0f82-4e2a-9cbf-6ac00f67fa16 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:04.513417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f7bdf405-0f82-4e2a-9cbf-6ac00f67fa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:04.643876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdf405-0f82-4e2a-9cbf-6ac00f67fa16 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:04.685827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:04.724110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07fbdd-f761-4953-9410-b5c6c6dfe7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:04.724796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07fbdd-f761-4953-9410-b5c6c6dfe7aa service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:04.725086 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07fbdd-f761-4953-9410-b5c6c6dfe7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:04.725366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07fbdd-f761-4953-9410-b5c6c6dfe7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:04.727109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8c07fbdd-f761-4953-9410-b5c6c6dfe7aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:04.842365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07fbdd-f761-4953-9410-b5c6c6dfe7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:04.843758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07fbdd-f761-4953-9410-b5c6c6dfe7aa service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:04.863090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 680/1343] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:07.627126 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af526fb-c6ab-44d8-991f-b932f765b078 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:07.627701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af526fb-c6ab-44d8-991f-b932f765b078 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:07.627701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af526fb-c6ab-44d8-991f-b932f765b078 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:07.629052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 664/1344] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:07.635189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18ff45-01be-4537-a7d8-77f94320f808 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:07.635878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18ff45-01be-4537-a7d8-77f94320f808 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:07.635878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18ff45-01be-4537-a7d8-77f94320f808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:07.704320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ed18ff45-01be-4537-a7d8-77f94320f808 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:07.705594 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ed18ff45-01be-4537-a7d8-77f94320f808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:07.723899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:07.805089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 681/1345] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:07.843856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af526fb-c6ab-44d8-991f-b932f765b078 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:07.846033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3af526fb-c6ab-44d8-991f-b932f765b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:07.967367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af526fb-c6ab-44d8-991f-b932f765b078 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:08.041680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b04785-9863-470d-ac11-c86690a7e724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:08.042439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b04785-9863-470d-ac11-c86690a7e724 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:08.042719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b04785-9863-470d-ac11-c86690a7e724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:08.042991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b04785-9863-470d-ac11-c86690a7e724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:08.044661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-69b04785-9863-470d-ac11-c86690a7e724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:08.090924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:08.161269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b04785-9863-470d-ac11-c86690a7e724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:08.162757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b04785-9863-470d-ac11-c86690a7e724 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:08.183008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 665/1346] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:12.720848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c421f-cc6d-400f-8a5f-bc97aaf114bc None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:12.721383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c421f-cc6d-400f-8a5f-bc97aaf114bc None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:12.721499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c421f-cc6d-400f-8a5f-bc97aaf114bc None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:12.723073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 682/1347] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:12.728783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb2a8b-60ba-41f0-ab72-f906c3af92a3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:12.729311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb2a8b-60ba-41f0-ab72-f906c3af92a3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:12.729467 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb2a8b-60ba-41f0-ab72-f906c3af92a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:12.801988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a6cb2a8b-60ba-41f0-ab72-f906c3af92a3 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:12.803279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a6cb2a8b-60ba-41f0-ab72-f906c3af92a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:12.910443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:12.914073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 666/1348] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:12.952076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c421f-cc6d-400f-8a5f-bc97aaf114bc None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:12.953732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-015c421f-cc6d-400f-8a5f-bc97aaf114bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:13.067600 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c421f-cc6d-400f-8a5f-bc97aaf114bc None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:13.117056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:13.144487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae916481-8d10-4917-b832-247df2916bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:13.145144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae916481-8d10-4917-b832-247df2916bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:13.145424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae916481-8d10-4917-b832-247df2916bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:13.145697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae916481-8d10-4917-b832-247df2916bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:13.147379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ae916481-8d10-4917-b832-247df2916bbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:13.266945 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae916481-8d10-4917-b832-247df2916bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:13.268303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae916481-8d10-4917-b832-247df2916bbf service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:13.287739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 683/1349] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:18.311267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a29538-79a6-4252-b552-ed1b91a2f1a2 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:18.312259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a29538-79a6-4252-b552-ed1b91a2f1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:18.312788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a29538-79a6-4252-b552-ed1b91a2f1a2 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:18.314670 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 667/1350] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:05:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:18.325944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7baf4-2c88-4ae4-89c2-9cbc8a16fd95 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:18.326463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7baf4-2c88-4ae4-89c2-9cbc8a16fd95 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:18.326568 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7baf4-2c88-4ae4-89c2-9cbc8a16fd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:18.464988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-97b7baf4-2c88-4ae4-89c2-9cbc8a16fd95 None None] MFA Rules not processed for user `2949783e08504cfba3dc52dcf8b6a015`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:18.466265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-97b7baf4-2c88-4ae4-89c2-9cbc8a16fd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:18.486200 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:18.587059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 684/1351] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:05:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:22.816775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774976fb-f41c-4523-b859-791e58f6ea06 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:22.817421 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774976fb-f41c-4523-b859-791e58f6ea06 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:22.817421 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774976fb-f41c-4523-b859-791e58f6ea06 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:22.818702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 668/1352] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:22.824091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d064b76-4fef-4c23-aec4-3033b327c3b4 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:22.824991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d064b76-4fef-4c23-aec4-3033b327c3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:22.825878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d064b76-4fef-4c23-aec4-3033b327c3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:22.909431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-7d064b76-4fef-4c23-aec4-3033b327c3b4 None None] MFA Rules not processed for user `2949783e08504cfba3dc52dcf8b6a015`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:22.910843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7d064b76-4fef-4c23-aec4-3033b327c3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:22.987942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:23.027787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 685/1353] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:05:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:24.490183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a67e4-9f7c-41a6-8212-a2c9bcea1ec7 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:24.490719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a67e4-9f7c-41a6-8212-a2c9bcea1ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:24.490719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a67e4-9f7c-41a6-8212-a2c9bcea1ec7 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:24.492041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 669/1354] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:24.497443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a06d58-a28f-41e1-8124-c39107a176c8 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:24.497882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a06d58-a28f-41e1-8124-c39107a176c8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:24.498017 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a06d58-a28f-41e1-8124-c39107a176c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:24.580466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-99a06d58-a28f-41e1-8124-c39107a176c8 None None] MFA Rules not processed for user `2949783e08504cfba3dc52dcf8b6a015`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:24.582070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-99a06d58-a28f-41e1-8124-c39107a176c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:24.694986 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 686/1355] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:05:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:05:28.126286 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f692e1b-8077-45ba-bd68-5818d2573857 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:28.126800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f692e1b-8077-45ba-bd68-5818d2573857 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:28.126899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f692e1b-8077-45ba-bd68-5818d2573857 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:28.128340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 670/1356] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:28.135388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9805d26-c39e-413d-a141-330ccecb248e None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:28.135920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9805d26-c39e-413d-a141-330ccecb248e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:28.136428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9805d26-c39e-413d-a141-330ccecb248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:28.183714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:28.231106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d9805d26-c39e-413d-a141-330ccecb248e None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:28.232530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d9805d26-c39e-413d-a141-330ccecb248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:28.337364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 687/1357] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:28.390909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936ed67-88a9-4774-9b56-d759c06b218e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:28.391406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936ed67-88a9-4774-9b56-d759c06b218e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:28.392134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936ed67-88a9-4774-9b56-d759c06b218e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:28.393655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 671/1358] 10.222.0.66 () {54 vars in 961 bytes} [Mon Jul 11 14:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:28.402516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd4f5e-d6ee-409d-a487-882edc8de05c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:28.402923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd4f5e-d6ee-409d-a487-882edc8de05c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:28.403847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd4f5e-d6ee-409d-a487-882edc8de05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:28.499607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-21fd4f5e-d6ee-409d-a487-882edc8de05c None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:28.501138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-21fd4f5e-d6ee-409d-a487-882edc8de05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:28.558678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:28.641952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 688/1359] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Jul 11 14:05:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:28.651413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936ed67-88a9-4774-9b56-d759c06b218e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:28.653058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5936ed67-88a9-4774-9b56-d759c06b218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:28.811200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936ed67-88a9-4774-9b56-d759c06b218e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:28.900076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:28.944208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736a9e1-9360-4758-a726-963dce91d45e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:28.945057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736a9e1-9360-4758-a726-963dce91d45e service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:28.946089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736a9e1-9360-4758-a726-963dce91d45e service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:28.946539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736a9e1-9360-4758-a726-963dce91d45e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:28.948366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0736a9e1-9360-4758-a726-963dce91d45e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:29.060336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736a9e1-9360-4758-a726-963dce91d45e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:29.062132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736a9e1-9360-4758-a726-963dce91d45e service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:29.081969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 672/1360] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:31.391255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ffce-1f41-4377-b083-425d48ed8d6d None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:31.391764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ffce-1f41-4377-b083-425d48ed8d6d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:31.391764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ffce-1f41-4377-b083-425d48ed8d6d None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:31.394499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 689/1361] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:31.398470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b7d6e-f57d-46fa-92b6-c2d5ad92e72f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:31.399122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b7d6e-f57d-46fa-92b6-c2d5ad92e72f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:31.399122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b7d6e-f57d-46fa-92b6-c2d5ad92e72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:31.470059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b49b7d6e-f57d-46fa-92b6-c2d5ad92e72f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:31.471230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b49b7d6e-f57d-46fa-92b6-c2d5ad92e72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:31.514807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:31.587465 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 673/1362] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:31.635015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623ffce-1f41-4377-b083-425d48ed8d6d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:31.636835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7623ffce-1f41-4377-b083-425d48ed8d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:31.824807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623ffce-1f41-4377-b083-425d48ed8d6d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:31.837817 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:31.999750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41f1cb-0cb5-4bbd-997d-d2bf2f0a6069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:32.000517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41f1cb-0cb5-4bbd-997d-d2bf2f0a6069 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:32.001075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41f1cb-0cb5-4bbd-997d-d2bf2f0a6069 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:32.001432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41f1cb-0cb5-4bbd-997d-d2bf2f0a6069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:32.003378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ca41f1cb-0cb5-4bbd-997d-d2bf2f0a6069 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:32.103853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41f1cb-0cb5-4bbd-997d-d2bf2f0a6069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:32.105555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41f1cb-0cb5-4bbd-997d-d2bf2f0a6069 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:32.126061 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 690/1363] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:34.559009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57668-872f-4c54-b5ca-1d67fc7f3959 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:34.559524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57668-872f-4c54-b5ca-1d67fc7f3959 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:34.559524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f57668-872f-4c54-b5ca-1d67fc7f3959 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:34.561389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 674/1364] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:34.567563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e6c48-af22-4181-aa56-12dbee4ca404 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:34.568200 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e6c48-af22-4181-aa56-12dbee4ca404 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:34.568200 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e6c48-af22-4181-aa56-12dbee4ca404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:34.585735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:34.652665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-3a8e6c48-af22-4181-aa56-12dbee4ca404 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:34.653920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3a8e6c48-af22-4181-aa56-12dbee4ca404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:34.782044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 691/1365] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:34.830473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20fd38-f092-4507-b94c-73a54626e4c6 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:34.830723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20fd38-f092-4507-b94c-73a54626e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:34.831053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20fd38-f092-4507-b94c-73a54626e4c6 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:34.832919 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 675/1366] 10.222.0.66 () {54 vars in 961 bytes} [Mon Jul 11 14:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:34.840024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397444f-50af-4365-b1b8-60c24c387df5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:34.840639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397444f-50af-4365-b1b8-60c24c387df5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:34.840758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397444f-50af-4365-b1b8-60c24c387df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:34.933033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0397444f-50af-4365-b1b8-60c24c387df5 None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:34.934271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0397444f-50af-4365-b1b8-60c24c387df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:34.972197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:35.062792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 692/1367] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Jul 11 14:05:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:35.070999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20fd38-f092-4507-b94c-73a54626e4c6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:35.072444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-aa20fd38-f092-4507-b94c-73a54626e4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:35.237166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20fd38-f092-4507-b94c-73a54626e4c6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:35.260759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:35.377618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50c9c4-bc43-4ddb-acc7-7f4e867c42a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:35.378493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50c9c4-bc43-4ddb-acc7-7f4e867c42a2 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:35.378803 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50c9c4-bc43-4ddb-acc7-7f4e867c42a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:35.379062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50c9c4-bc43-4ddb-acc7-7f4e867c42a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:35.380786 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fd50c9c4-bc43-4ddb-acc7-7f4e867c42a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:35.482303 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50c9c4-bc43-4ddb-acc7-7f4e867c42a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:35.483956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50c9c4-bc43-4ddb-acc7-7f4e867c42a2 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:35.503193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 676/1368] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:36.661795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be00f0-4fa8-46f3-9756-176887812d4a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:36.662452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be00f0-4fa8-46f3-9756-176887812d4a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:36.662452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be00f0-4fa8-46f3-9756-176887812d4a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:36.663990 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 693/1369] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:36.669521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3a14-1ac0-4ff4-9f05-2ec513e90a77 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:36.669959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3a14-1ac0-4ff4-9f05-2ec513e90a77 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:36.670102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3a14-1ac0-4ff4-9f05-2ec513e90a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:36.702743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:36.741646 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d90a3a14-1ac0-4ff4-9f05-2ec513e90a77 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:36.743191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d90a3a14-1ac0-4ff4-9f05-2ec513e90a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:36.852406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 677/1370] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:37.207101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825859d-79b1-4728-a0bb-65282409ffba None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:37.207101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825859d-79b1-4728-a0bb-65282409ffba None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:37.207101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825859d-79b1-4728-a0bb-65282409ffba None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:37.208099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 694/1371] 10.222.0.66 () {54 vars in 963 bytes} [Mon Jul 11 14:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:37.213621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b6e6-06d6-4767-9972-863f86d829a7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:37.213868 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b6e6-06d6-4767-9972-863f86d829a7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:37.214250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384b6e6-06d6-4767-9972-863f86d829a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:37.295464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9384b6e6-06d6-4767-9972-863f86d829a7 None None] MFA Rules not processed for user `a5cf559c8a69483ca7625f37d5931439`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:37.296955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9384b6e6-06d6-4767-9972-863f86d829a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:37.355259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:37.390361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 678/1372] 10.222.0.66 () {58 vars in 1060 bytes} [Mon Jul 11 14:05:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:05:37.398467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825859d-79b1-4728-a0bb-65282409ffba None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:37.400318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a825859d-79b1-4728-a0bb-65282409ffba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:37.522661 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825859d-79b1-4728-a0bb-65282409ffba None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:37.572174 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:37.613289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c3349-3b8c-4447-94d3-07dbbc6bbceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:37.614027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c3349-3b8c-4447-94d3-07dbbc6bbceb service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:37.614346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c3349-3b8c-4447-94d3-07dbbc6bbceb service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:37.614625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c3349-3b8c-4447-94d3-07dbbc6bbceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:37.616372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5f6c3349-3b8c-4447-94d3-07dbbc6bbceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:37.755302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c3349-3b8c-4447-94d3-07dbbc6bbceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:37.756817 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c3349-3b8c-4447-94d3-07dbbc6bbceb service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:37.774535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8382-ecda-44e8-a62f-f8e0ebb3a237 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:37.775055 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8382-ecda-44e8-a62f-f8e0ebb3a237 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:37.775140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8382-ecda-44e8-a62f-f8e0ebb3a237 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:37.776612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 679/1373] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:05:37.779762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 695/1374] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:37.781553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793d6d-076c-44c4-a7d2-a4fd3415dc31 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:37.781844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793d6d-076c-44c4-a7d2-a4fd3415dc31 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:37.782129 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793d6d-076c-44c4-a7d2-a4fd3415dc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:37.858257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-95793d6d-076c-44c4-a7d2-a4fd3415dc31 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:37.859662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-95793d6d-076c-44c4-a7d2-a4fd3415dc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:37.963708 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 680/1375] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:38.011339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c3349-3b8c-4447-94d3-07dbbc6bbceb service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:38.012466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5f6c3349-3b8c-4447-94d3-07dbbc6bbceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:38.081235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:38.117560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c3349-3b8c-4447-94d3-07dbbc6bbceb service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:38.243699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff9ad6-b26d-4ca5-85c0-3712138599ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:38.244285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9ad6-b26d-4ca5-85c0-3712138599ab service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:38.244573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9ad6-b26d-4ca5-85c0-3712138599ab service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:38.244851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff9ad6-b26d-4ca5-85c0-3712138599ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:38.246552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-47ff9ad6-b26d-4ca5-85c0-3712138599ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:38.329680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:38.342305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff9ad6-b26d-4ca5-85c0-3712138599ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:38.344009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff9ad6-b26d-4ca5-85c0-3712138599ab service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:38.363180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 696/1376] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:40.479015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00135a72-4c98-4812-9583-6aeba5e82132 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:40.479764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00135a72-4c98-4812-9583-6aeba5e82132 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:40.479764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00135a72-4c98-4812-9583-6aeba5e82132 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:40.481192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 681/1377] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:40.487801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798ab3-4a31-4ca0-a1b0-2d94b7dd6304 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:40.487801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798ab3-4a31-4ca0-a1b0-2d94b7dd6304 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:40.487801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798ab3-4a31-4ca0-a1b0-2d94b7dd6304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:40.576274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ff798ab3-4a31-4ca0-a1b0-2d94b7dd6304 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:40.578753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ff798ab3-4a31-4ca0-a1b0-2d94b7dd6304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:40.709378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 697/1378] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:40.763089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00135a72-4c98-4812-9583-6aeba5e82132 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:40.765055 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-00135a72-4c98-4812-9583-6aeba5e82132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:40.826924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:40.947358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00135a72-4c98-4812-9583-6aeba5e82132 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:41.121798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994f95d-ae59-4a88-bcdc-8129d64daedd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:41.122901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994f95d-ae59-4a88-bcdc-8129d64daedd service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:41.124136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994f95d-ae59-4a88-bcdc-8129d64daedd service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:41.124136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994f95d-ae59-4a88-bcdc-8129d64daedd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:41.125678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5994f95d-ae59-4a88-bcdc-8129d64daedd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:41.138925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:41.241483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994f95d-ae59-4a88-bcdc-8129d64daedd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:41.244612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994f95d-ae59-4a88-bcdc-8129d64daedd service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:41.266148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 682/1379] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:43.395732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c970bc-dd94-442d-8c0b-f6b41cbeb74e None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:43.396267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c970bc-dd94-442d-8c0b-f6b41cbeb74e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:43.396554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c970bc-dd94-442d-8c0b-f6b41cbeb74e None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:43.398590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 698/1380] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:43.404005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067f045-85e7-4368-bacf-776d84137fd8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:43.404473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067f045-85e7-4368-bacf-776d84137fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:43.404642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067f045-85e7-4368-bacf-776d84137fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:43.476208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8067f045-85e7-4368-bacf-776d84137fd8 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:43.477627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8067f045-85e7-4368-bacf-776d84137fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:43.576701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:43.596333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 683/1381] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:43.641413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c970bc-dd94-442d-8c0b-f6b41cbeb74e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:43.643247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-72c970bc-dd94-442d-8c0b-f6b41cbeb74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:43.724414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:43.822233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c970bc-dd94-442d-8c0b-f6b41cbeb74e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:43.951770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c3468-0958-4d84-a6c8-8aaba81e5eb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:43.952511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3468-0958-4d84-a6c8-8aaba81e5eb7 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:43.952867 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3468-0958-4d84-a6c8-8aaba81e5eb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:43.953217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3468-0958-4d84-a6c8-8aaba81e5eb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:43.954979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-636c3468-0958-4d84-a6c8-8aaba81e5eb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:43.979617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:44.062193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c3468-0958-4d84-a6c8-8aaba81e5eb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:44.064059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c3468-0958-4d84-a6c8-8aaba81e5eb7 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:44.087695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 699/1382] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:46.417135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f76482-4382-4ee2-8adb-5bd283fe1ff3 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:46.417816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f76482-4382-4ee2-8adb-5bd283fe1ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:46.417816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f76482-4382-4ee2-8adb-5bd283fe1ff3 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:46.419100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 684/1383] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:05:46.424457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655412-5f02-4e98-85e1-0acf6e3bd55f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:46.424971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655412-5f02-4e98-85e1-0acf6e3bd55f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:46.425105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655412-5f02-4e98-85e1-0acf6e3bd55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:46.505532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-bc655412-5f02-4e98-85e1-0acf6e3bd55f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:46.508727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-bc655412-5f02-4e98-85e1-0acf6e3bd55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:46.626434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:46.633412 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 700/1384] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:46.681351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f76482-4382-4ee2-8adb-5bd283fe1ff3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:46.683905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-51f76482-4382-4ee2-8adb-5bd283fe1ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:46.863115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f76482-4382-4ee2-8adb-5bd283fe1ff3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:46.931530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:46.986697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d634168-929e-474d-845d-ee28a96c031a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:46.987424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d634168-929e-474d-845d-ee28a96c031a service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:46.987661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d634168-929e-474d-845d-ee28a96c031a service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:46.988003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d634168-929e-474d-845d-ee28a96c031a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:46.989745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0d634168-929e-474d-845d-ee28a96c031a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:47.093482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d634168-929e-474d-845d-ee28a96c031a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:47.095259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d634168-929e-474d-845d-ee28a96c031a service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:47.116179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 685/1385] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:05:49.325794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db752c0d-150d-4726-a4d5-6f726d4f0ade None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:49.326394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db752c0d-150d-4726-a4d5-6f726d4f0ade None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:49.326394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db752c0d-150d-4726-a4d5-6f726d4f0ade None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:49.327860 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 701/1386] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:49.333238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820663-262c-43f8-9f25-9d8fefd94dff None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:49.333815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820663-262c-43f8-9f25-9d8fefd94dff None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:49.333815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820663-262c-43f8-9f25-9d8fefd94dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:49.420696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b2820663-262c-43f8-9f25-9d8fefd94dff None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:49.422383 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b2820663-262c-43f8-9f25-9d8fefd94dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:49.456531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:49.536039 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 686/1387] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:49.580483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db752c0d-150d-4726-a4d5-6f726d4f0ade None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:49.582010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-db752c0d-150d-4726-a4d5-6f726d4f0ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:49.762002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db752c0d-150d-4726-a4d5-6f726d4f0ade None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:49.843770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:49.894502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f8963-bce3-4bbc-9cb3-45de824c22e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:49.895187 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f8963-bce3-4bbc-9cb3-45de824c22e8 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:49.895483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f8963-bce3-4bbc-9cb3-45de824c22e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:49.895776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f8963-bce3-4bbc-9cb3-45de824c22e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:49.898427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2e2f8963-bce3-4bbc-9cb3-45de824c22e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:50.006746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f8963-bce3-4bbc-9cb3-45de824c22e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:50.008380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f8963-bce3-4bbc-9cb3-45de824c22e8 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:50.028268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 702/1388] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:52.124090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aad5d-fbc4-492c-99f2-766c9cdd19a1 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:52.124666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aad5d-fbc4-492c-99f2-766c9cdd19a1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:52.124666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84aad5d-fbc4-492c-99f2-766c9cdd19a1 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:52.126119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 687/1389] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:52.131719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ebc86-93b8-4890-9b96-034fd0268f7b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:52.132188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ebc86-93b8-4890-9b96-034fd0268f7b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:52.132279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ebc86-93b8-4890-9b96-034fd0268f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:52.202984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b90ebc86-93b8-4890-9b96-034fd0268f7b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:52.204282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b90ebc86-93b8-4890-9b96-034fd0268f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:52.243409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:52.308699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 703/1390] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:52.353557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84aad5d-fbc4-492c-99f2-766c9cdd19a1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:52.355165 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c84aad5d-fbc4-492c-99f2-766c9cdd19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:52.508529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84aad5d-fbc4-492c-99f2-766c9cdd19a1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:52.517911 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:52.625204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31600f45-cfbc-461a-9d9a-fd0e5f03827f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:52.625860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600f45-cfbc-461a-9d9a-fd0e5f03827f service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:52.626143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600f45-cfbc-461a-9d9a-fd0e5f03827f service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:52.626444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600f45-cfbc-461a-9d9a-fd0e5f03827f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:52.628089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-31600f45-cfbc-461a-9d9a-fd0e5f03827f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:52.719548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31600f45-cfbc-461a-9d9a-fd0e5f03827f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:52.721120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31600f45-cfbc-461a-9d9a-fd0e5f03827f service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:52.739197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 688/1391] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:53.677951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa323c-4b66-4dd8-8e2c-d5573c0c4bf7 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:53.679158 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa323c-4b66-4dd8-8e2c-d5573c0c4bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:53.679158 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa323c-4b66-4dd8-8e2c-d5573c0c4bf7 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:53.680695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 704/1392] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:53.686133 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cbc7a-6b77-4453-8b49-0a454ff8be83 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:53.686557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cbc7a-6b77-4453-8b49-0a454ff8be83 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:53.686777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cbc7a-6b77-4453-8b49-0a454ff8be83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:53.701563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:53.753556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-217cbc7a-6b77-4453-8b49-0a454ff8be83 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:53.754802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-217cbc7a-6b77-4453-8b49-0a454ff8be83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:53.857958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 689/1393] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:53.918235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15861fdc-7867-4aef-82b2-6cccdffbdfc3 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:53.918540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15861fdc-7867-4aef-82b2-6cccdffbdfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:53.918831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15861fdc-7867-4aef-82b2-6cccdffbdfc3 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:53.920222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 705/1394] 10.222.0.66 () {54 vars in 962 bytes} [Mon Jul 11 14:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:53.925312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc677e6-72b1-413d-a6fa-05ef5dcd743b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:53.925611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc677e6-72b1-413d-a6fa-05ef5dcd743b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:53.925894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc677e6-72b1-413d-a6fa-05ef5dcd743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:54.003193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-dbc677e6-72b1-413d-a6fa-05ef5dcd743b None None] MFA Rules not processed for user `690a93a4d6ed4666a607b05a8c2b6549`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:54.004344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dbc677e6-72b1-413d-a6fa-05ef5dcd743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:54.042110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:54.088561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 690/1395] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Jul 11 14:05:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:54.101801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15861fdc-7867-4aef-82b2-6cccdffbdfc3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:54.103490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-15861fdc-7867-4aef-82b2-6cccdffbdfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:54.214423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15861fdc-7867-4aef-82b2-6cccdffbdfc3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:54.276989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:54.289895 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dae438-b2a0-444d-9e36-bfcc6c40f8fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '690a93a4d6ed4666a607b05a8c2b6549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:54.290615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dae438-b2a0-444d-9e36-bfcc6c40f8fb service glance] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:54.290910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dae438-b2a0-444d-9e36-bfcc6c40f8fb service glance] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:54.291217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dae438-b2a0-444d-9e36-bfcc6c40f8fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:54.292979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-58dae438-b2a0-444d-9e36-bfcc6c40f8fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:54.403001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dae438-b2a0-444d-9e36-bfcc6c40f8fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:54.404516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dae438-b2a0-444d-9e36-bfcc6c40f8fb service glance] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:54.424561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 706/1396] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:05:54.844754 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae3af6-d803-4dd0-ad48-1ca34248df4e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:54.845315 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae3af6-d803-4dd0-ad48-1ca34248df4e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:54.845315 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae3af6-d803-4dd0-ad48-1ca34248df4e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:54.846642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 691/1397] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:54.852663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26c954-4d50-4b60-b5e4-456e93345303 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:54.853142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26c954-4d50-4b60-b5e4-456e93345303 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:54.853369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26c954-4d50-4b60-b5e4-456e93345303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:54.923789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5b26c954-4d50-4b60-b5e4-456e93345303 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:54.925016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5b26c954-4d50-4b60-b5e4-456e93345303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:54.967997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:55.030777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 707/1398] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:05:55.076107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae3af6-d803-4dd0-ad48-1ca34248df4e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:55.078119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-45ae3af6-d803-4dd0-ad48-1ca34248df4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:55.158203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4401610-2559-42c4-8e11-9be356518335 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:55.158568 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4401610-2559-42c4-8e11-9be356518335 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:55.158919 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4401610-2559-42c4-8e11-9be356518335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:55.229180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d4401610-2559-42c4-8e11-9be356518335 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:55.230425 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d4401610-2559-42c4-8e11-9be356518335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:55.239377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae3af6-d803-4dd0-ad48-1ca34248df4e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:55.284723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:55.318315 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 708/1399] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:05:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:05:55.362703 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc786a0-ca1d-4a4d-93a8-c8899a59d329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:55.363357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc786a0-ca1d-4a4d-93a8-c8899a59d329 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:55.363637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc786a0-ca1d-4a4d-93a8-c8899a59d329 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:55.363937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc786a0-ca1d-4a4d-93a8-c8899a59d329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:55.365568 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4bc786a0-ca1d-4a4d-93a8-c8899a59d329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:55.375157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97aa5-496a-4c38-898a-c8fc6d8804f3 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:55.375538 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97aa5-496a-4c38-898a-c8fc6d8804f3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:55.375885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97aa5-496a-4c38-898a-c8fc6d8804f3 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:55.377339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 709/1400] 10.222.0.66 () {54 vars in 942 bytes} [Mon Jul 11 14:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:05:55.384388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698377b8-53b8-46d1-850d-e659d10f8658 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:55.384687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698377b8-53b8-46d1-850d-e659d10f8658 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:55.385302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698377b8-53b8-46d1-850d-e659d10f8658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:55.429764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:55.464486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc786a0-ca1d-4a4d-93a8-c8899a59d329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:55.464762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-698377b8-53b8-46d1-850d-e659d10f8658 None None] MFA Rules not processed for user `945586c90ac148b8880b9ad6409b02f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:55.466303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-698377b8-53b8-46d1-850d-e659d10f8658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:55.466426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc786a0-ca1d-4a4d-93a8-c8899a59d329 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:55.488838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 692/1401] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:05:55.581400 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 710/1402] 10.222.0.66 () {58 vars in 1039 bytes} [Mon Jul 11 14:05:55 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:05:55.592176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc786a0-ca1d-4a4d-93a8-c8899a59d329 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:55.593585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4bc786a0-ca1d-4a4d-93a8-c8899a59d329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:55.648531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:55.699522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc786a0-ca1d-4a4d-93a8-c8899a59d329 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:55.810953 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8482bf3-537a-447b-a142-6f711a05f363 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:55.811613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8482bf3-537a-447b-a142-6f711a05f363 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:55.811893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8482bf3-537a-447b-a142-6f711a05f363 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:55.812168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8482bf3-537a-447b-a142-6f711a05f363 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:55.813865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a8482bf3-537a-447b-a142-6f711a05f363 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:55.898604 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:55.902783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8482bf3-537a-447b-a142-6f711a05f363 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:55.904648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8482bf3-537a-447b-a142-6f711a05f363 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:55.913644 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 693/1403] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:05:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:05:57.631447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80da9d-e4b0-43c0-93c0-acb9c58b9a25 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:57.632189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80da9d-e4b0-43c0-93c0-acb9c58b9a25 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:57.632189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80da9d-e4b0-43c0-93c0-acb9c58b9a25 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:57.633712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 711/1404] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:05:57.639437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56fb70-a923-4478-b21d-2463624871ef None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:57.639917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56fb70-a923-4478-b21d-2463624871ef None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:57.640000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56fb70-a923-4478-b21d-2463624871ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:57.718682 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fe56fb70-a923-4478-b21d-2463624871ef None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:05:57.719960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fe56fb70-a923-4478-b21d-2463624871ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:57.827768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 694/1405] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:05:57.875238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80da9d-e4b0-43c0-93c0-acb9c58b9a25 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:05:57.876812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7e80da9d-e4b0-43c0-93c0-acb9c58b9a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:57.983151 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:58.045513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80da9d-e4b0-43c0-93c0-acb9c58b9a25 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:05:58.194781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de37338-d1b7-4821-bd90-8808ba5ba982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:05:58.195744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de37338-d1b7-4821-bd90-8808ba5ba982 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:05:58.196693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de37338-d1b7-4821-bd90-8808ba5ba982 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:05:58.196982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de37338-d1b7-4821-bd90-8808ba5ba982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:05:58.198866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9de37338-d1b7-4821-bd90-8808ba5ba982 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:05:58.273949 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:05:58.312730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de37338-d1b7-4821-bd90-8808ba5ba982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:05:58.314402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de37338-d1b7-4821-bd90-8808ba5ba982 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:05:58.333709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 712/1406] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:00.488180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e567fc-49f5-4cac-81b3-ac3803caaceb None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:00.488775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e567fc-49f5-4cac-81b3-ac3803caaceb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:00.488775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e567fc-49f5-4cac-81b3-ac3803caaceb None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:00.490119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 695/1407] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:00.496176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cfe88-01ee-40af-992f-ca4cf0d20180 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:00.496731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cfe88-01ee-40af-992f-ca4cf0d20180 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:00.497208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cfe88-01ee-40af-992f-ca4cf0d20180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:00.574561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-836cfe88-01ee-40af-992f-ca4cf0d20180 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:00.576135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-836cfe88-01ee-40af-992f-ca4cf0d20180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:00.702601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 713/1408] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:06:00.737278 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e567fc-49f5-4cac-81b3-ac3803caaceb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:00.738949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d6e567fc-49f5-4cac-81b3-ac3803caaceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:00.829533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:00.921142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e567fc-49f5-4cac-81b3-ac3803caaceb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:01.061471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce2214-b9ac-4fc8-846c-589bc7ed0447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:01.062042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce2214-b9ac-4fc8-846c-589bc7ed0447 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:01.062355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce2214-b9ac-4fc8-846c-589bc7ed0447 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:01.062635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce2214-b9ac-4fc8-846c-589bc7ed0447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:01.064908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6fce2214-b9ac-4fc8-846c-589bc7ed0447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:01.106493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:01.173030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce2214-b9ac-4fc8-846c-589bc7ed0447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:01.174780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce2214-b9ac-4fc8-846c-589bc7ed0447 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:01.195773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 696/1409] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:10.688786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=85 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:11.192484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=30 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:18.778098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b7df-bc05-4318-9c84-ed2419e0814d None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:18.778744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b7df-bc05-4318-9c84-ed2419e0814d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:18.778744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b7df-bc05-4318-9c84-ed2419e0814d None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:18.780072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 714/1410] 10.222.0.66 () {54 vars in 918 bytes} [Mon Jul 11 14:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:18.785107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bd774-5766-47c5-88a0-2941a4eae494 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:18.785522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bd774-5766-47c5-88a0-2941a4eae494 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:18.785675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bd774-5766-47c5-88a0-2941a4eae494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:18.861560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-555bd774-5766-47c5-88a0-2941a4eae494 None None] MFA Rules not processed for user `2949783e08504cfba3dc52dcf8b6a015`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:18.862808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-555bd774-5766-47c5-88a0-2941a4eae494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:18.971134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 697/1411] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Jul 11 14:06:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:18.986613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc266b9-9903-4ff7-b082-2ddccccc2943 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:18.986954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc266b9-9903-4ff7-b082-2ddccccc2943 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:18.987191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc266b9-9903-4ff7-b082-2ddccccc2943 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:18.988564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 715/1412] 10.222.0.66 () {54 vars in 918 bytes} [Mon Jul 11 14:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:18.993102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2b751-cfb5-434b-9b32-5c265c93b4bb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:18.993394 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2b751-cfb5-434b-9b32-5c265c93b4bb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:18.993674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2b751-cfb5-434b-9b32-5c265c93b4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:19.066040 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:19.069069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f7b2b751-cfb5-434b-9b32-5c265c93b4bb None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:19.070897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f7b2b751-cfb5-434b-9b32-5c265c93b4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:19.199387 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 698/1413] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Jul 11 14:06:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:21.758115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0abee-4784-4a0d-9b7f-9332c70889e8 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:21.758704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0abee-4784-4a0d-9b7f-9332c70889e8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:21.758704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0abee-4784-4a0d-9b7f-9332c70889e8 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:21.760104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:21.765514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bb147-8725-4c6c-a6f6-439e4d8c4ad8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:21.765931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bb147-8725-4c6c-a6f6-439e4d8c4ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:21.766054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bb147-8725-4c6c-a6f6-439e4d8c4ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:21.832115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9e0bb147-8725-4c6c-a6f6-439e4d8c4ad8 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:21.833366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9e0bb147-8725-4c6c-a6f6-439e4d8c4ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:21.892691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:21.935976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:21.981169 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0abee-4784-4a0d-9b7f-9332c70889e8 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:21.982747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2fb0abee-4784-4a0d-9b7f-9332c70889e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:22.128611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0abee-4784-4a0d-9b7f-9332c70889e8 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:22.203635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:22.246000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcd7f2-e65e-4bc5-a928-8b1b12e514f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:22.246685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd7f2-e65e-4bc5-a928-8b1b12e514f3 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:22.246968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd7f2-e65e-4bc5-a928-8b1b12e514f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:22.247244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcd7f2-e65e-4bc5-a928-8b1b12e514f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:22.248897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a1bcd7f2-e65e-4bc5-a928-8b1b12e514f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:22.337891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcd7f2-e65e-4bc5-a928-8b1b12e514f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:22.339555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcd7f2-e65e-4bc5-a928-8b1b12e514f3 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:22.357712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 717/1416] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:23.277746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79f60c-8a40-4652-9ec9-9468d998b8b3 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:23.278341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79f60c-8a40-4652-9ec9-9468d998b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:23.278341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79f60c-8a40-4652-9ec9-9468d998b8b3 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:23.279684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:23.284587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a5e05-a4e0-4072-95f9-c4ce3081f9b2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:23.285008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a5e05-a4e0-4072-95f9-c4ce3081f9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:23.285146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a5e05-a4e0-4072-95f9-c4ce3081f9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:23.359338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-899a5e05-a4e0-4072-95f9-c4ce3081f9b2 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:23.360547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-899a5e05-a4e0-4072-95f9-c4ce3081f9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:23.387961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:23.458118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:06:23.610424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79f60c-8a40-4652-9ec9-9468d998b8b3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:23.612139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ee79f60c-8a40-4652-9ec9-9468d998b8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:23.755997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79f60c-8a40-4652-9ec9-9468d998b8b3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:23.795086 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:23.869186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256178a-cc45-4c51-b46d-11aa65d676b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:23.869852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256178a-cc45-4c51-b46d-11aa65d676b7 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:23.870146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256178a-cc45-4c51-b46d-11aa65d676b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:23.870454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256178a-cc45-4c51-b46d-11aa65d676b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:23.872170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6256178a-cc45-4c51-b46d-11aa65d676b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:23.962640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256178a-cc45-4c51-b46d-11aa65d676b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:23.964257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256178a-cc45-4c51-b46d-11aa65d676b7 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:23.985953 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 701/1419] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:24.871862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58761863-6094-46b2-ab9f-1ea3a9da643a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:24.872373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58761863-6094-46b2-ab9f-1ea3a9da643a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:24.872373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58761863-6094-46b2-ab9f-1ea3a9da643a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:24.873830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:24.879035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ee297-873f-40ff-9241-d23244af7067 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:24.880290 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ee297-873f-40ff-9241-d23244af7067 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:24.880578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ee297-873f-40ff-9241-d23244af7067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:24.935476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:24.958766 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-dd6ee297-873f-40ff-9241-d23244af7067 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:24.960015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dd6ee297-873f-40ff-9241-d23244af7067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:25.056803 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:25.211804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58761863-6094-46b2-ab9f-1ea3a9da643a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:25.213370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-58761863-6094-46b2-ab9f-1ea3a9da643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:25.368384 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58761863-6094-46b2-ab9f-1ea3a9da643a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:25.381694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:25.485915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf96e02-bb75-48b0-bf2f-a7f4ffeee223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:25.486513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf96e02-bb75-48b0-bf2f-a7f4ffeee223 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:25.486921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf96e02-bb75-48b0-bf2f-a7f4ffeee223 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:25.487207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf96e02-bb75-48b0-bf2f-a7f4ffeee223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:25.488870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-abf96e02-bb75-48b0-bf2f-a7f4ffeee223 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:25.583490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf96e02-bb75-48b0-bf2f-a7f4ffeee223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:25.583490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf96e02-bb75-48b0-bf2f-a7f4ffeee223 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:25.604690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 720/1422] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:26.476584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25d923-b367-49c3-88b7-1b91b381d2bb None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:26.477082 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25d923-b367-49c3-88b7-1b91b381d2bb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:26.477082 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25d923-b367-49c3-88b7-1b91b381d2bb None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:26.478519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:26.483484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46035e-11b3-41b8-9335-07978e65fff5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:26.483900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46035e-11b3-41b8-9335-07978e65fff5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:26.484043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46035e-11b3-41b8-9335-07978e65fff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:26.502314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:26.560716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-2e46035e-11b3-41b8-9335-07978e65fff5 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:26.561922 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2e46035e-11b3-41b8-9335-07978e65fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:26.675345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:26.830790 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25d923-b367-49c3-88b7-1b91b381d2bb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:26.832245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4c25d923-b367-49c3-88b7-1b91b381d2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:26.945594 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:26.982831 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25d923-b367-49c3-88b7-1b91b381d2bb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:27.108048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa112f-a8fb-4d71-b0cf-f9543b100bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:27.108738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa112f-a8fb-4d71-b0cf-f9543b100bec service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:27.109074 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa112f-a8fb-4d71-b0cf-f9543b100bec service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:27.109403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa112f-a8fb-4d71-b0cf-f9543b100bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:27.111389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-deaa112f-a8fb-4d71-b0cf-f9543b100bec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:27.190735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:27.205293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa112f-a8fb-4d71-b0cf-f9543b100bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:27.206969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa112f-a8fb-4d71-b0cf-f9543b100bec service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:27.226355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 704/1425] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:28.100654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f26af5-313a-478e-ab88-f50385d8491f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:28.101205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f26af5-313a-478e-ab88-f50385d8491f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:28.101205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f26af5-313a-478e-ab88-f50385d8491f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:28.102630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:28.107736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3fc04-ca8b-4ba5-80a7-747a9e181d73 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:28.108158 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3fc04-ca8b-4ba5-80a7-747a9e181d73 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:28.108317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3fc04-ca8b-4ba5-80a7-747a9e181d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:28.187355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f9b3fc04-ca8b-4ba5-80a7-747a9e181d73 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:28.188607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f9b3fc04-ca8b-4ba5-80a7-747a9e181d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:28.287644 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:28.443537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f26af5-313a-478e-ab88-f50385d8491f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:28.445561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b1f26af5-313a-478e-ab88-f50385d8491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:28.534005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:28.603323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f26af5-313a-478e-ab88-f50385d8491f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:28.716597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248198e-b699-472b-bffd-1f48274e0258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:28.717159 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248198e-b699-472b-bffd-1f48274e0258 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:28.717441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248198e-b699-472b-bffd-1f48274e0258 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:28.717717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248198e-b699-472b-bffd-1f48274e0258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:28.719406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6248198e-b699-472b-bffd-1f48274e0258 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:28.767591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:28.809656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248198e-b699-472b-bffd-1f48274e0258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:28.811326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248198e-b699-472b-bffd-1f48274e0258 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:28.829509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 723/1428] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:29.659526 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d88ce6-4fb8-447c-ae9a-a451ff363b55 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:29.660100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d88ce6-4fb8-447c-ae9a-a451ff363b55 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:29.660100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d88ce6-4fb8-447c-ae9a-a451ff363b55 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:29.661535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:29.666770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a918785-4255-43e5-abf5-1b70e8c06303 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:29.667212 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a918785-4255-43e5-abf5-1b70e8c06303 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:29.667345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a918785-4255-43e5-abf5-1b70e8c06303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:29.746953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-6a918785-4255-43e5-abf5-1b70e8c06303 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:29.748183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6a918785-4255-43e5-abf5-1b70e8c06303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:29.845959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:29.998113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d88ce6-4fb8-447c-ae9a-a451ff363b55 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:29.999606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-71d88ce6-4fb8-447c-ae9a-a451ff363b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:30.050808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:30.153420 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d88ce6-4fb8-447c-ae9a-a451ff363b55 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:30.267379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ec3b2-0b9a-4c6b-a68d-339c4bc8092b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:30.267948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec3b2-0b9a-4c6b-a68d-339c4bc8092b service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:30.268229 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec3b2-0b9a-4c6b-a68d-339c4bc8092b service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:30.268503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ec3b2-0b9a-4c6b-a68d-339c4bc8092b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:30.270213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c13ec3b2-0b9a-4c6b-a68d-339c4bc8092b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:30.277389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:30.367960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ec3b2-0b9a-4c6b-a68d-339c4bc8092b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:30.369626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ec3b2-0b9a-4c6b-a68d-339c4bc8092b service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:30.392699 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 707/1431] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:31.222071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78d0b3-e82a-4611-bbc6-f48320d80484 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:31.222617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78d0b3-e82a-4611-bbc6-f48320d80484 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:31.222796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78d0b3-e82a-4611-bbc6-f48320d80484 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:31.224328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:31.229355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4dee-8fdb-488e-8cf6-2a3b14b71dab None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:31.229810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4dee-8fdb-488e-8cf6-2a3b14b71dab None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:31.229917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a4dee-8fdb-488e-8cf6-2a3b14b71dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:31.304919 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3e8a4dee-8fdb-488e-8cf6-2a3b14b71dab None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:31.306200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3e8a4dee-8fdb-488e-8cf6-2a3b14b71dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:31.377613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:31.408432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:31.566172 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78d0b3-e82a-4611-bbc6-f48320d80484 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:31.568475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6e78d0b3-e82a-4611-bbc6-f48320d80484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:31.586628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:31.721044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78d0b3-e82a-4611-bbc6-f48320d80484 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:31.811630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:31.837694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ae11e-a6b6-4168-af86-0a3977a5b4f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:31.838374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae11e-a6b6-4168-af86-0a3977a5b4f4 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:31.838664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae11e-a6b6-4168-af86-0a3977a5b4f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:31.838943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae11e-a6b6-4168-af86-0a3977a5b4f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:31.840592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-380ae11e-a6b6-4168-af86-0a3977a5b4f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:31.933769 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ae11e-a6b6-4168-af86-0a3977a5b4f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:31.935477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ae11e-a6b6-4168-af86-0a3977a5b4f4 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:31.954810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 726/1434] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:32.768725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1a61f-8f73-478e-ba1c-ea976366024c None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:32.769284 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1a61f-8f73-478e-ba1c-ea976366024c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:32.769284 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1a61f-8f73-478e-ba1c-ea976366024c None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:32.771445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:32.776436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ad215-e675-4fa2-b657-67bde9811b92 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:32.776866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ad215-e675-4fa2-b657-67bde9811b92 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:32.777007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ad215-e675-4fa2-b657-67bde9811b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:32.852809 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-742ad215-e675-4fa2-b657-67bde9811b92 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:32.854037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-742ad215-e675-4fa2-b657-67bde9811b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:32.896870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:32.955134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:06:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:33.107571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1a61f-8f73-478e-ba1c-ea976366024c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:33.109166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2ce1a61f-8f73-478e-ba1c-ea976366024c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:33.262296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1a61f-8f73-478e-ba1c-ea976366024c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:33.316354 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:33.377892 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66327075-28f4-46b2-9efe-1ca71876106b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:33.378586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327075-28f4-46b2-9efe-1ca71876106b service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:33.378874 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327075-28f4-46b2-9efe-1ca71876106b service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:33.379156 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66327075-28f4-46b2-9efe-1ca71876106b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:33.381417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-66327075-28f4-46b2-9efe-1ca71876106b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:33.471722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66327075-28f4-46b2-9efe-1ca71876106b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:33.473801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66327075-28f4-46b2-9efe-1ca71876106b service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:33.492523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 710/1437] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:34.309191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473f1cc-6dfd-4f1a-8f97-cd3999abb8af None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:34.309755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473f1cc-6dfd-4f1a-8f97-cd3999abb8af None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:34.309755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473f1cc-6dfd-4f1a-8f97-cd3999abb8af None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:34.311190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:34.316152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640601a-461f-4409-a354-b484b1f0cc07 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:34.316604 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640601a-461f-4409-a354-b484b1f0cc07 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:34.317243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640601a-461f-4409-a354-b484b1f0cc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:34.392607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-2640601a-461f-4409-a354-b484b1f0cc07 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:34.393901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2640601a-461f-4409-a354-b484b1f0cc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:34.398659 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:34.496250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:34.650265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473f1cc-6dfd-4f1a-8f97-cd3999abb8af None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:34.651869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3473f1cc-6dfd-4f1a-8f97-cd3999abb8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:34.807243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473f1cc-6dfd-4f1a-8f97-cd3999abb8af None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:34.834838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:34.924011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d8fea-8cac-43b3-b1e2-a89eaffabb95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:34.924573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d8fea-8cac-43b3-b1e2-a89eaffabb95 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:34.924854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d8fea-8cac-43b3-b1e2-a89eaffabb95 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:34.925126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d8fea-8cac-43b3-b1e2-a89eaffabb95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:34.927322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a21d8fea-8cac-43b3-b1e2-a89eaffabb95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:35.018956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d8fea-8cac-43b3-b1e2-a89eaffabb95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:35.020712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d8fea-8cac-43b3-b1e2-a89eaffabb95 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:35.041960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 729/1440] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:37.027211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd04d7f-6666-44b1-b93e-6a57bf74983b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:37.027803 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd04d7f-6666-44b1-b93e-6a57bf74983b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:37.027803 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd04d7f-6666-44b1-b93e-6a57bf74983b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:37.029140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:37.034371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f6eba-6a14-4cf3-8b40-6b3f55f62f10 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:37.034822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f6eba-6a14-4cf3-8b40-6b3f55f62f10 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:37.034929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f6eba-6a14-4cf3-8b40-6b3f55f62f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:37.078328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:37.108609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f27f6eba-6a14-4cf3-8b40-6b3f55f62f10 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:37.109836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f27f6eba-6a14-4cf3-8b40-6b3f55f62f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:37.209657 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:37.248467 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd04d7f-6666-44b1-b93e-6a57bf74983b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:37.250006 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4dd04d7f-6666-44b1-b93e-6a57bf74983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:37.352128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd04d7f-6666-44b1-b93e-6a57bf74983b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:37.387645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:37.430480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae36595-1a6e-418f-9be2-096078867683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:37.431135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36595-1a6e-418f-9be2-096078867683 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:37.431421 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36595-1a6e-418f-9be2-096078867683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:37.431696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36595-1a6e-418f-9be2-096078867683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:37.433352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1ae36595-1a6e-418f-9be2-096078867683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:37.541445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae36595-1a6e-418f-9be2-096078867683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:37.542963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae36595-1a6e-418f-9be2-096078867683 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:37.562175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 713/1443] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:39.754966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc5b11-36c5-420a-829f-3b9cd773e58f None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:39.755517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc5b11-36c5-420a-829f-3b9cd773e58f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:39.755517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc5b11-36c5-420a-829f-3b9cd773e58f None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:39.756929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:39.762424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504281b8-fe58-4736-b6d4-ea45c4c70ddb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:39.762857 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504281b8-fe58-4736-b6d4-ea45c4c70ddb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:39.762994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504281b8-fe58-4736-b6d4-ea45c4c70ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:39.945870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-504281b8-fe58-4736-b6d4-ea45c4c70ddb None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:39.947134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-504281b8-fe58-4736-b6d4-ea45c4c70ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:39.960747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:40.056306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:40.093886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc5b11-36c5-420a-829f-3b9cd773e58f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:40.095539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-71bc5b11-36c5-420a-829f-3b9cd773e58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:40.204432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc5b11-36c5-420a-829f-3b9cd773e58f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:40.217900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:40.279690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6da2f3-ee08-4a35-b1e8-fab9a744221e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:40.280343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6da2f3-ee08-4a35-b1e8-fab9a744221e service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:40.280625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6da2f3-ee08-4a35-b1e8-fab9a744221e service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:40.280903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6da2f3-ee08-4a35-b1e8-fab9a744221e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:40.282600 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4c6da2f3-ee08-4a35-b1e8-fab9a744221e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:40.394146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6da2f3-ee08-4a35-b1e8-fab9a744221e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:40.396291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6da2f3-ee08-4a35-b1e8-fab9a744221e service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:40.415205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 732/1446] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:42.874373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeceb48f-8049-4716-ba83-2b21c80ed622 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:42.874929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeceb48f-8049-4716-ba83-2b21c80ed622 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:42.874929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeceb48f-8049-4716-ba83-2b21c80ed622 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:42.876336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:42.881835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11517cf8-1119-4fb4-9d4c-4b004bf41338 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:42.882306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11517cf8-1119-4fb4-9d4c-4b004bf41338 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:42.882465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11517cf8-1119-4fb4-9d4c-4b004bf41338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:42.930881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:42.949749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-11517cf8-1119-4fb4-9d4c-4b004bf41338 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:42.951005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-11517cf8-1119-4fb4-9d4c-4b004bf41338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:43.049221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:43.089077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeceb48f-8049-4716-ba83-2b21c80ed622 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:43.090652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-eeceb48f-8049-4716-ba83-2b21c80ed622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:43.196199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeceb48f-8049-4716-ba83-2b21c80ed622 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:43.239720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:43.276110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9f086-debf-4d36-b7be-2595626ef9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:43.276769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9f086-debf-4d36-b7be-2595626ef9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:43.277055 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9f086-debf-4d36-b7be-2595626ef9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:43.277327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9f086-debf-4d36-b7be-2595626ef9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:43.279016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dca9f086-debf-4d36-b7be-2595626ef9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:43.386691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9f086-debf-4d36-b7be-2595626ef9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:43.388136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9f086-debf-4d36-b7be-2595626ef9c3 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:43.407227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 716/1449] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:45.591772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d7e29-fe0a-4ecb-854c-ff6a04e4910a None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:45.592286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d7e29-fe0a-4ecb-854c-ff6a04e4910a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:45.592286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d7e29-fe0a-4ecb-854c-ff6a04e4910a None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:45.593621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:45.600356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0c2c-7ea0-461b-b6fa-51409e362308 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:45.600356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0c2c-7ea0-461b-b6fa-51409e362308 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:45.600356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd0c2c-7ea0-461b-b6fa-51409e362308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:45.666906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8efd0c2c-7ea0-461b-b6fa-51409e362308 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:45.668134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8efd0c2c-7ea0-461b-b6fa-51409e362308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:45.689054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:45.765592 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:45.806141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d7e29-fe0a-4ecb-854c-ff6a04e4910a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:45.807794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3f8d7e29-fe0a-4ecb-854c-ff6a04e4910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:45.920767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d7e29-fe0a-4ecb-854c-ff6a04e4910a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:45.940450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:45.994622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e07953-cd66-4237-a849-84d3d7864a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:45.995281 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07953-cd66-4237-a849-84d3d7864a54 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:45.995570 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07953-cd66-4237-a849-84d3d7864a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:45.995878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07953-cd66-4237-a849-84d3d7864a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:45.997587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-18e07953-cd66-4237-a849-84d3d7864a54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:46.114901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e07953-cd66-4237-a849-84d3d7864a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:46.116374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e07953-cd66-4237-a849-84d3d7864a54 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:46.134738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 735/1452] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:48.279883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d7da-cc15-4d12-b7b2-decb1452fb73 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:48.280450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d7da-cc15-4d12-b7b2-decb1452fb73 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:48.280450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063d7da-cc15-4d12-b7b2-decb1452fb73 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:48.282203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:06:48.287659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f7b7-e092-421e-9e51-62b3e83faed2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:48.288121 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f7b7-e092-421e-9e51-62b3e83faed2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:48.288252 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013f7b7-e092-421e-9e51-62b3e83faed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:48.353841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:48.356646 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5013f7b7-e092-421e-9e51-62b3e83faed2 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:48.358430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5013f7b7-e092-421e-9e51-62b3e83faed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:48.455726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:48.494892 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063d7da-cc15-4d12-b7b2-decb1452fb73 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:48.496431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7063d7da-cc15-4d12-b7b2-decb1452fb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:48.601894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063d7da-cc15-4d12-b7b2-decb1452fb73 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:48.650875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:48.676848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58918913-0d61-46a4-bd77-2cfe753cca96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:48.677509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918913-0d61-46a4-bd77-2cfe753cca96 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:48.677795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918913-0d61-46a4-bd77-2cfe753cca96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:48.678075 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918913-0d61-46a4-bd77-2cfe753cca96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:48.679778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-58918913-0d61-46a4-bd77-2cfe753cca96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:48.787761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58918913-0d61-46a4-bd77-2cfe753cca96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:48.789128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58918913-0d61-46a4-bd77-2cfe753cca96 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:48.808036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 719/1455] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:50.935223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9e7b2-42f6-4cc8-9ae9-37caffdb1ca5 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:50.935760 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9e7b2-42f6-4cc8-9ae9-37caffdb1ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:50.935860 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9e7b2-42f6-4cc8-9ae9-37caffdb1ca5 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:50.937255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:50.943311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fed3-3c49-4821-a633-4b8ccbf3f3b6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:50.943860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fed3-3c49-4821-a633-4b8ccbf3f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:50.943860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031fed3-3c49-4821-a633-4b8ccbf3f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:51.008643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e031fed3-3c49-4821-a633-4b8ccbf3f3b6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:51.009896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e031fed3-3c49-4821-a633-4b8ccbf3f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:51.039684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:51.107086 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:06:51.145783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9e7b2-42f6-4cc8-9ae9-37caffdb1ca5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:51.147420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7ef9e7b2-42f6-4cc8-9ae9-37caffdb1ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:51.255546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9e7b2-42f6-4cc8-9ae9-37caffdb1ca5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:51.283564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:51.331015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038cf97-2e3b-4dc7-8725-5e978a62c7cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:51.331777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038cf97-2e3b-4dc7-8725-5e978a62c7cf service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:51.332168 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038cf97-2e3b-4dc7-8725-5e978a62c7cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:51.332940 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038cf97-2e3b-4dc7-8725-5e978a62c7cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:51.334136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1038cf97-2e3b-4dc7-8725-5e978a62c7cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:51.444076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038cf97-2e3b-4dc7-8725-5e978a62c7cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:51.445574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038cf97-2e3b-4dc7-8725-5e978a62c7cf service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:51.464698 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 738/1458] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:53.584222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173be63-30ca-44df-98e1-84d79f57547e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:53.584802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173be63-30ca-44df-98e1-84d79f57547e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:53.584938 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173be63-30ca-44df-98e1-84d79f57547e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:53.586456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:53.592259 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded7217-86e1-43ff-87cb-8a5a83aca66c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:53.592720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded7217-86e1-43ff-87cb-8a5a83aca66c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:53.592891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded7217-86e1-43ff-87cb-8a5a83aca66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:53.658059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-9ded7217-86e1-43ff-87cb-8a5a83aca66c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:53.659413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9ded7217-86e1-43ff-87cb-8a5a83aca66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:53.668505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:53.758467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:53.796292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173be63-30ca-44df-98e1-84d79f57547e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:53.797830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4173be63-30ca-44df-98e1-84d79f57547e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:53.923732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173be63-30ca-44df-98e1-84d79f57547e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:53.979699 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:53.998520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be9b3e-673a-4ec7-a297-87d5a6924558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:53.999166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9b3e-673a-4ec7-a297-87d5a6924558 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:53.999443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9b3e-673a-4ec7-a297-87d5a6924558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:53.999715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9b3e-673a-4ec7-a297-87d5a6924558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:54.001361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f6be9b3e-673a-4ec7-a297-87d5a6924558 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:54.110541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be9b3e-673a-4ec7-a297-87d5a6924558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:54.111995 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be9b3e-673a-4ec7-a297-87d5a6924558 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:54.130555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 722/1461] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:56.221402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cdf4-6293-408a-9cd2-cb6e8fbccaa5 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:56.221821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cdf4-6293-408a-9cd2-cb6e8fbccaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:56.221969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cdf4-6293-408a-9cd2-cb6e8fbccaa5 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:56.223438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:56.229561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a60cdc-fce3-4c93-8296-485c0c5365b2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:56.230001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a60cdc-fce3-4c93-8296-485c0c5365b2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:56.230109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a60cdc-fce3-4c93-8296-485c0c5365b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:56.299554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-20a60cdc-fce3-4c93-8296-485c0c5365b2 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:56.300810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-20a60cdc-fce3-4c93-8296-485c0c5365b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:56.343398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:56.403574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:56.440905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7cdf4-6293-408a-9cd2-cb6e8fbccaa5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:56.442693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-00f7cdf4-6293-408a-9cd2-cb6e8fbccaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:56.680576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7cdf4-6293-408a-9cd2-cb6e8fbccaa5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:56.719352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:56.755444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f4a0d-2656-4e40-bed9-f5362f67183a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:56.756099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4a0d-2656-4e40-bed9-f5362f67183a service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:56.756386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4a0d-2656-4e40-bed9-f5362f67183a service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:56.756664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f4a0d-2656-4e40-bed9-f5362f67183a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:56.758345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-788f4a0d-2656-4e40-bed9-f5362f67183a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:56.868589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f4a0d-2656-4e40-bed9-f5362f67183a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:56.870054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f4a0d-2656-4e40-bed9-f5362f67183a service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:56.888721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 741/1464] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:06:58.975222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739c67-31d8-41d3-a395-2d6dce743f81 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:58.975797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739c67-31d8-41d3-a395-2d6dce743f81 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:58.975797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d739c67-31d8-41d3-a395-2d6dce743f81 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:58.977208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:06:58.982771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1449da-8b9b-4728-9050-9868f15af35b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:58.983234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1449da-8b9b-4728-9050-9868f15af35b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:58.983332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1449da-8b9b-4728-9050-9868f15af35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:59.050943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-bc1449da-8b9b-4728-9050-9868f15af35b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:06:59.052318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-bc1449da-8b9b-4728-9050-9868f15af35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:59.070818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:59.150577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:06:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:06:59.186740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739c67-31d8-41d3-a395-2d6dce743f81 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:06:59.188321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5d739c67-31d8-41d3-a395-2d6dce743f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:59.293623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d739c67-31d8-41d3-a395-2d6dce743f81 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:06:59.360420 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:06:59.368765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465b6b4-df10-45ae-93ff-d49e4e5b3533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:06:59.369422 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465b6b4-df10-45ae-93ff-d49e4e5b3533 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:06:59.369704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465b6b4-df10-45ae-93ff-d49e4e5b3533 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:06:59.370332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465b6b4-df10-45ae-93ff-d49e4e5b3533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:06:59.372015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3465b6b4-df10-45ae-93ff-d49e4e5b3533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:06:59.480749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465b6b4-df10-45ae-93ff-d49e4e5b3533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:06:59.482213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465b6b4-df10-45ae-93ff-d49e4e5b3533 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:06:59.500788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 725/1467] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:01.599915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d54cf2-07e3-4a71-8a63-4f387fda77b9 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:01.600547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d54cf2-07e3-4a71-8a63-4f387fda77b9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:01.600547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d54cf2-07e3-4a71-8a63-4f387fda77b9 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:01.601901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:01.607871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055320a5-b305-443b-89bf-dcae6d74866a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:01.608433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055320a5-b305-443b-89bf-dcae6d74866a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:01.608542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055320a5-b305-443b-89bf-dcae6d74866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:01.677306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-055320a5-b305-443b-89bf-dcae6d74866a None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:01.678576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-055320a5-b305-443b-89bf-dcae6d74866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:01.726954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:01.777663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:01.813759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d54cf2-07e3-4a71-8a63-4f387fda77b9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:01.815395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-97d54cf2-07e3-4a71-8a63-4f387fda77b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:01.929811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d54cf2-07e3-4a71-8a63-4f387fda77b9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:01.982704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:02.008872 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf3606-04f7-48d4-a32e-7a1465baf364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:02.009565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf3606-04f7-48d4-a32e-7a1465baf364 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:02.009850 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf3606-04f7-48d4-a32e-7a1465baf364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:02.010128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf3606-04f7-48d4-a32e-7a1465baf364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:02.011857 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f9cf3606-04f7-48d4-a32e-7a1465baf364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:02.120776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf3606-04f7-48d4-a32e-7a1465baf364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:02.122140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf3606-04f7-48d4-a32e-7a1465baf364 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:02.140427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 744/1470] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:11.775758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=22 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:12.137831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=66 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:22.223341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ff3fd-4616-41ba-84fc-70adc4ac2f2e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:22.223830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ff3fd-4616-41ba-84fc-70adc4ac2f2e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:22.224063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ff3fd-4616-41ba-84fc-70adc4ac2f2e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:22.225455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 727/1471] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:22.230931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3023-1b46-4d35-b0c5-372a8868da7f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:22.231375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3023-1b46-4d35-b0c5-372a8868da7f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:22.231483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3023-1b46-4d35-b0c5-372a8868da7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:22.295328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-357d3023-1b46-4d35-b0c5-372a8868da7f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:22.296549 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-357d3023-1b46-4d35-b0c5-372a8868da7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:22.395134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 745/1472] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:22.480646 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b12ab-9d79-48cf-b73a-1e1a254e682f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:22.480935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b12ab-9d79-48cf-b73a-1e1a254e682f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:22.481213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b12ab-9d79-48cf-b73a-1e1a254e682f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:22.482929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 728/1473] 10.222.0.66 () {54 vars in 962 bytes} [Mon Jul 11 14:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:22.487547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f195-b009-41d2-8bd5-01399512ee62 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:22.487842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f195-b009-41d2-8bd5-01399512ee62 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:22.488126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817f195-b009-41d2-8bd5-01399512ee62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:22.564737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c817f195-b009-41d2-8bd5-01399512ee62 None None] MFA Rules not processed for user `690a93a4d6ed4666a607b05a8c2b6549`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:22.565964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c817f195-b009-41d2-8bd5-01399512ee62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:22.587988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:22.647186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 746/1474] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Jul 11 14:07:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:22.654697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b12ab-9d79-48cf-b73a-1e1a254e682f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:22.656287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4f9b12ab-9d79-48cf-b73a-1e1a254e682f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:22.759638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b12ab-9d79-48cf-b73a-1e1a254e682f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:22.834601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1cde8-d323-4b13-b0f5-55cee9a87b4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '690a93a4d6ed4666a607b05a8c2b6549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:22.835267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1cde8-d323-4b13-b0f5-55cee9a87b4f service glance] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:22.835599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1cde8-d323-4b13-b0f5-55cee9a87b4f service glance] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:22.835921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1cde8-d323-4b13-b0f5-55cee9a87b4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:22.837619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4bb1cde8-d323-4b13-b0f5-55cee9a87b4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:22.891779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:22.948472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1cde8-d323-4b13-b0f5-55cee9a87b4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:22.949929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1cde8-d323-4b13-b0f5-55cee9a87b4f service glance] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:22.968223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 729/1475] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:25.149175 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8823ef-33d8-4062-89b2-d877cfa4b391 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:25.149754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8823ef-33d8-4062-89b2-d877cfa4b391 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:25.149754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8823ef-33d8-4062-89b2-d877cfa4b391 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:25.151165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 747/1476] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:25.156501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e900e-2901-4256-8459-07fdadd9ca13 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:25.156895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e900e-2901-4256-8459-07fdadd9ca13 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:25.157063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e900e-2901-4256-8459-07fdadd9ca13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:25.224003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-019e900e-2901-4256-8459-07fdadd9ca13 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:25.225288 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-019e900e-2901-4256-8459-07fdadd9ca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:25.320534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 730/1477] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:25.344448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8823ef-33d8-4062-89b2-d877cfa4b391 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:25.345979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ee8823ef-33d8-4062-89b2-d877cfa4b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:25.473492 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8823ef-33d8-4062-89b2-d877cfa4b391 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:25.521759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:25.567352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a3775-e876-486b-bbd7-9009878533c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:25.568049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3775-e876-486b-bbd7-9009878533c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:25.568440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3775-e876-486b-bbd7-9009878533c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:25.568810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3775-e876-486b-bbd7-9009878533c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:25.569623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a3775-e876-486b-bbd7-9009878533c7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:25.571598 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-460a3775-e876-486b-bbd7-9009878533c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:07:25.571598 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: warnings.warn(msg) Jul 11 14:07:25.571598 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: Jul 11 14:07:25.572729 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a3775-e876-486b-bbd7-9009878533c7 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:25.592232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 748/1478] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Jul 11 14:07:25 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:07:27.758290 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af80e4-c24e-48fc-b183-2aea49567238 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:27.758858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af80e4-c24e-48fc-b183-2aea49567238 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:27.758858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af80e4-c24e-48fc-b183-2aea49567238 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:27.760219 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 731/1479] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:27.765665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12e13b-9bf0-4c76-8a99-bb2997b92a22 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:27.766107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12e13b-9bf0-4c76-8a99-bb2997b92a22 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:27.766287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12e13b-9bf0-4c76-8a99-bb2997b92a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:27.830743 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ee12e13b-9bf0-4c76-8a99-bb2997b92a22 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:27.832571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ee12e13b-9bf0-4c76-8a99-bb2997b92a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:27.929559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 749/1480] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:27.974223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af80e4-c24e-48fc-b183-2aea49567238 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:27.976005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-04af80e4-c24e-48fc-b183-2aea49567238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:27.985773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:28.122809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af80e4-c24e-48fc-b183-2aea49567238 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:28.203753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:28.238597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c831ed-a264-4477-8610-38473da4212a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:28.239248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c831ed-a264-4477-8610-38473da4212a service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:28.239535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c831ed-a264-4477-8610-38473da4212a service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:28.239814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c831ed-a264-4477-8610-38473da4212a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:28.241469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-59c831ed-a264-4477-8610-38473da4212a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:28.338886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c831ed-a264-4477-8610-38473da4212a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:28.340508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c831ed-a264-4477-8610-38473da4212a service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:28.360212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 732/1481] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:30.663878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca603-aa63-4a37-94d1-e66aa57c7f39 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:30.664455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca603-aa63-4a37-94d1-e66aa57c7f39 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:30.664455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca603-aa63-4a37-94d1-e66aa57c7f39 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:30.665993 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 750/1482] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:30.671299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b869136-844c-41fc-8528-7563e4bd4985 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:30.671750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b869136-844c-41fc-8528-7563e4bd4985 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:30.671893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b869136-844c-41fc-8528-7563e4bd4985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:30.741702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4b869136-844c-41fc-8528-7563e4bd4985 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:30.742854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4b869136-844c-41fc-8528-7563e4bd4985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:30.790258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:30.840326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 733/1483] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:30.877350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ca603-aa63-4a37-94d1-e66aa57c7f39 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:30.878980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d33ca603-aa63-4a37-94d1-e66aa57c7f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:30.904595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:30.986285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ca603-aa63-4a37-94d1-e66aa57c7f39 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:31.064483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e56b3-de06-4637-b25d-07656607bef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:31.065118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e56b3-de06-4637-b25d-07656607bef8 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:31.065420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e56b3-de06-4637-b25d-07656607bef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:31.065713 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e56b3-de06-4637-b25d-07656607bef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:31.067938 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3d2e56b3-de06-4637-b25d-07656607bef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:31.149490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:31.187396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e56b3-de06-4637-b25d-07656607bef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:31.188863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e56b3-de06-4637-b25d-07656607bef8 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:31.208943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 751/1484] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:33.371916 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c5f45-0d3c-4135-b773-6f6258afbcda None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:33.372498 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c5f45-0d3c-4135-b773-6f6258afbcda None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:33.372498 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c5f45-0d3c-4135-b773-6f6258afbcda None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:33.373756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 734/1485] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:33.379516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377615ad-fd3a-43d4-9fc0-33e2ccfa6c28 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:33.379992 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377615ad-fd3a-43d4-9fc0-33e2ccfa6c28 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:33.380106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377615ad-fd3a-43d4-9fc0-33e2ccfa6c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:33.453494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-377615ad-fd3a-43d4-9fc0-33e2ccfa6c28 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:33.454750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-377615ad-fd3a-43d4-9fc0-33e2ccfa6c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:33.552689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 752/1486] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:33.591267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c5f45-0d3c-4135-b773-6f6258afbcda None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:33.592813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b21c5f45-0d3c-4135-b773-6f6258afbcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:33.716499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c5f45-0d3c-4135-b773-6f6258afbcda None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:33.790525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:33.792414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc36f5-fdfb-4a32-9cc5-72070b16e442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:33.793085 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc36f5-fdfb-4a32-9cc5-72070b16e442 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:33.793565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc36f5-fdfb-4a32-9cc5-72070b16e442 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:33.794061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc36f5-fdfb-4a32-9cc5-72070b16e442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:33.795985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2ccc36f5-fdfb-4a32-9cc5-72070b16e442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:33.911536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc36f5-fdfb-4a32-9cc5-72070b16e442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:33.912999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc36f5-fdfb-4a32-9cc5-72070b16e442 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:33.932825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 735/1487] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:36.120814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0c9b4-846d-49f4-a8fa-a14fb814ee8c None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:36.121366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0c9b4-846d-49f4-a8fa-a14fb814ee8c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:36.121366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0c9b4-846d-49f4-a8fa-a14fb814ee8c None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:36.122791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 753/1488] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:36.128720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b30f3-20e9-4e5a-9498-abb9b45e60ef None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:36.129168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b30f3-20e9-4e5a-9498-abb9b45e60ef None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:36.129381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b30f3-20e9-4e5a-9498-abb9b45e60ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:36.192688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-798b30f3-20e9-4e5a-9498-abb9b45e60ef None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:36.193910 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-798b30f3-20e9-4e5a-9498-abb9b45e60ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:36.247882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:36.292442 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 736/1489] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:36.333082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0c9b4-846d-49f4-a8fa-a14fb814ee8c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:36.334658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-05a0c9b4-846d-49f4-a8fa-a14fb814ee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:36.370988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:36.447958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0c9b4-846d-49f4-a8fa-a14fb814ee8c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:36.528865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c593161-0967-4427-914b-ec13fa59ad25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:36.529748 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c593161-0967-4427-914b-ec13fa59ad25 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:36.530146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c593161-0967-4427-914b-ec13fa59ad25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:36.530579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c593161-0967-4427-914b-ec13fa59ad25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:36.532520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9c593161-0967-4427-914b-ec13fa59ad25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:36.615254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:36.646225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c593161-0967-4427-914b-ec13fa59ad25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:36.647690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c593161-0967-4427-914b-ec13fa59ad25 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:36.666976 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 754/1490] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:38.937585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b5c6-892a-4a18-a570-31f18aac3946 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:38.938185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b5c6-892a-4a18-a570-31f18aac3946 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:38.938606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715b5c6-892a-4a18-a570-31f18aac3946 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:38.940004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 737/1491] 10.222.0.66 () {54 vars in 926 bytes} [Mon Jul 11 14:07:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:07:38.946322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6dba2-6dcd-4e92-adb9-edac195f9905 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:38.946777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6dba2-6dcd-4e92-adb9-edac195f9905 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:38.946875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6dba2-6dcd-4e92-adb9-edac195f9905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:39.011919 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c1b6dba2-6dcd-4e92-adb9-edac195f9905 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:07:39.013388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c1b6dba2-6dcd-4e92-adb9-edac195f9905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:39.110246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 755/1492] 10.222.0.66 () {58 vars in 1023 bytes} [Mon Jul 11 14:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:07:39.161253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b5c6-892a-4a18-a570-31f18aac3946 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:07:39.162947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d715b5c6-892a-4a18-a570-31f18aac3946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:39.275571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715b5c6-892a-4a18-a570-31f18aac3946 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:07:39.353796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f62bed-09ea-4efd-b980-c5c9e9637d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:07:39.354473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62bed-09ea-4efd-b980-c5c9e9637d17 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:07:39.354757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62bed-09ea-4efd-b980-c5c9e9637d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:07:39.355030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f62bed-09ea-4efd-b980-c5c9e9637d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:07:39.356688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-52f62bed-09ea-4efd-b980-c5c9e9637d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:07:39.366502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:39.475501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f62bed-09ea-4efd-b980-c5c9e9637d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:07:39.476998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f62bed-09ea-4efd-b980-c5c9e9637d17 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:07:39.497154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 738/1493] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:07:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:07:49.108354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=82 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:07:49.494538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=50 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:22.180915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3374c3-97cd-4f7a-b344-8af859ad4402 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:22.181532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3374c3-97cd-4f7a-b344-8af859ad4402 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:22.181532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3374c3-97cd-4f7a-b344-8af859ad4402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:22.256469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4a3374c3-97cd-4f7a-b344-8af859ad4402 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:22.257679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4a3374c3-97cd-4f7a-b344-8af859ad4402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:22.353269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 756/1494] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:22.361818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980cd76-e5c9-4803-9fa5-a32c63334f8b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:22.362500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980cd76-e5c9-4803-9fa5-a32c63334f8b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:22.362500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980cd76-e5c9-4803-9fa5-a32c63334f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:22.437528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6980cd76-e5c9-4803-9fa5-a32c63334f8b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:22.438720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6980cd76-e5c9-4803-9fa5-a32c63334f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:22.557480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 739/1495] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:22.562081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3374c3-97cd-4f7a-b344-8af859ad4402 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:22.563343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4a3374c3-97cd-4f7a-b344-8af859ad4402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:22.574788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3374c3-97cd-4f7a-b344-8af859ad4402 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:22.637002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:22.671207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d82857-8f1d-4c35-895c-57c467e02023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:22.671882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d82857-8f1d-4c35-895c-57c467e02023 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:22.672171 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d82857-8f1d-4c35-895c-57c467e02023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:22.672452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d82857-8f1d-4c35-895c-57c467e02023 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:22.673180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d82857-8f1d-4c35-895c-57c467e02023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:09:22.674289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d82857-8f1d-4c35-895c-57c467e02023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:22.675334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-36d82857-8f1d-4c35-895c-57c467e02023 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:09:22.675334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: warnings.warn(msg) Jul 11 14:09:22.675334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: Jul 11 14:09:22.676226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d82857-8f1d-4c35-895c-57c467e02023 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:22.687735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 757/1496] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:09:22.695962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980cd76-e5c9-4803-9fa5-a32c63334f8b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:22.705191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980cd76-e5c9-4803-9fa5-a32c63334f8b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:22.766691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:22.805032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42804668-a674-4c74-9851-c4ba69239fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:22.805705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42804668-a674-4c74-9851-c4ba69239fea admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:22.805998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42804668-a674-4c74-9851-c4ba69239fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:22.806316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42804668-a674-4c74-9851-c4ba69239fea admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:22.807027 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42804668-a674-4c74-9851-c4ba69239fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:22.808785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-42804668-a674-4c74-9851-c4ba69239fea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:09:22.808785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: warnings.warn(msg) Jul 11 14:09:22.808785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: Jul 11 14:09:22.809988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42804668-a674-4c74-9851-c4ba69239fea admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:22.866667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 740/1497] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:09:22 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:09:22.871310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d82857-8f1d-4c35-895c-57c467e02023 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:22.872922 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-36d82857-8f1d-4c35-895c-57c467e02023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:22.906442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d82857-8f1d-4c35-895c-57c467e02023 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:23.000520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa29a5a-d2f4-4f13-9480-f1076a971eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:23.001107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa29a5a-d2f4-4f13-9480-f1076a971eac admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:23.001390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa29a5a-d2f4-4f13-9480-f1076a971eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:23.001701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa29a5a-d2f4-4f13-9480-f1076a971eac admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:23.002488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa29a5a-d2f4-4f13-9480-f1076a971eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:23.003507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-4aa29a5a-d2f4-4f13-9480-f1076a971eac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:09:23.003507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: warnings.warn(msg) Jul 11 14:09:23.003507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: Jul 11 14:09:23.004712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa29a5a-d2f4-4f13-9480-f1076a971eac admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:23.045810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 758/1498] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:09:22 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:09:23.050032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42804668-a674-4c74-9851-c4ba69239fea admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:23.051576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-42804668-a674-4c74-9851-c4ba69239fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:23.114898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42804668-a674-4c74-9851-c4ba69239fea admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:23.197997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:23.210484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112d634-aa94-4d40-a039-6402a85d98e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:23.214105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112d634-aa94-4d40-a039-6402a85d98e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:23.214105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112d634-aa94-4d40-a039-6402a85d98e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:23.214105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112d634-aa94-4d40-a039-6402a85d98e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:23.214105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112d634-aa94-4d40-a039-6402a85d98e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:23.214105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-3112d634-aa94-4d40-a039-6402a85d98e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:09:23.214105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: warnings.warn(msg) Jul 11 14:09:23.214105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: Jul 11 14:09:23.216026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112d634-aa94-4d40-a039-6402a85d98e4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:23.229907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 741/1499] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:09:23.233952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa29a5a-d2f4-4f13-9480-f1076a971eac admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:23.235518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4aa29a5a-d2f4-4f13-9480-f1076a971eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:23.247040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa29a5a-d2f4-4f13-9480-f1076a971eac admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:23.274063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:23.345214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12bc53-30f5-4def-824e-acba04738ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:23.345918 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12bc53-30f5-4def-824e-acba04738ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:23.346408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12bc53-30f5-4def-824e-acba04738ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:23.346693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12bc53-30f5-4def-824e-acba04738ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:23.347430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12bc53-30f5-4def-824e-acba04738ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:23.348453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-8f12bc53-30f5-4def-824e-acba04738ec4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:09:23.348453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: warnings.warn(msg) Jul 11 14:09:23.348453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: Jul 11 14:09:23.349341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12bc53-30f5-4def-824e-acba04738ec4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:23.361966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 759/1500] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:09:23.366230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112d634-aa94-4d40-a039-6402a85d98e4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:23.367816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3112d634-aa94-4d40-a039-6402a85d98e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:23.402031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112d634-aa94-4d40-a039-6402a85d98e4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:23.496456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba5196-61b2-493b-a87c-3ab4c0fceb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:23.497349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5196-61b2-493b-a87c-3ab4c0fceb0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:23.497632 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5196-61b2-493b-a87c-3ab4c0fceb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:23.497907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5196-61b2-493b-a87c-3ab4c0fceb0c admin admin] PATH_INFO: `/v3/projects/c75b5933024849a994b5b2c98e293c7c/users/0e88a07bf9ae4a5f9b8aa69dacf62cda/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:23.521570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba5196-61b2-493b-a87c-3ab4c0fceb0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75b5933024849a994b5b2c98e293c7c, user_id=0e88a07bf9ae4a5f9b8aa69dacf62cda, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:23.522641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-c9ba5196-61b2-493b-a87c-3ab4c0fceb0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:09:23.522641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: warnings.warn(msg) Jul 11 14:09:23.522641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: Jul 11 14:09:23.524667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba5196-61b2-493b-a87c-3ab4c0fceb0c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:23.550057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 742/1501] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:09:23 2022] PUT /identity/v3/projects/c75b5933024849a994b5b2c98e293c7c/users/0e88a07bf9ae4a5f9b8aa69dacf62cda/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:09:23.562246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10504c-8821-402f-85da-7dd530364769 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:23.562550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10504c-8821-402f-85da-7dd530364769 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:23.562835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10504c-8821-402f-85da-7dd530364769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:23.622316 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4a10504c-8821-402f-85da-7dd530364769 None None] MFA Rules not processed for user `0e88a07bf9ae4a5f9b8aa69dacf62cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:23.623534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4a10504c-8821-402f-85da-7dd530364769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:23.703205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 760/1502] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:09:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:23.716423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a026-66ef-4bef-94c7-8ed2d09d1571 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:23.716721 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a026-66ef-4bef-94c7-8ed2d09d1571 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:23.717004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753a026-66ef-4bef-94c7-8ed2d09d1571 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:23.718415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 743/1503] 10.222.0.66 () {54 vars in 963 bytes} [Mon Jul 11 14:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:23.723280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ecf3-1714-43fe-ae61-a52c6ec85c07 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:23.723574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ecf3-1714-43fe-ae61-a52c6ec85c07 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:23.723854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2ecf3-1714-43fe-ae61-a52c6ec85c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:23.754104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:23.797209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-20a2ecf3-1714-43fe-ae61-a52c6ec85c07 None None] MFA Rules not processed for user `a5cf559c8a69483ca7625f37d5931439`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:23.798438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-20a2ecf3-1714-43fe-ae61-a52c6ec85c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:23.884865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 761/1504] 10.222.0.66 () {58 vars in 1060 bytes} [Mon Jul 11 14:09:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:23.893051 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753a026-66ef-4bef-94c7-8ed2d09d1571 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:23.894780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2753a026-66ef-4bef-94c7-8ed2d09d1571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:23.945853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:24.007914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753a026-66ef-4bef-94c7-8ed2d09d1571 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:24.085973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f35495-9acc-4a42-b054-e6a722e34750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:24.086554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f35495-9acc-4a42-b054-e6a722e34750 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:24.086837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f35495-9acc-4a42-b054-e6a722e34750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:24.087112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f35495-9acc-4a42-b054-e6a722e34750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:24.088817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-52f35495-9acc-4a42-b054-e6a722e34750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:24.195564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f35495-9acc-4a42-b054-e6a722e34750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:24.197013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f35495-9acc-4a42-b054-e6a722e34750 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:24.200656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:24.216587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 744/1505] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:24.260210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80312036-bb99-4809-b4d3-24ee77e08bef None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:24.260660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80312036-bb99-4809-b4d3-24ee77e08bef None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:24.260765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80312036-bb99-4809-b4d3-24ee77e08bef None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:24.262320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 762/1506] 10.222.0.66 () {52 vars in 829 bytes} [Mon Jul 11 14:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:09:24.265861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f35495-9acc-4a42-b054-e6a722e34750 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:24.267117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-52f35495-9acc-4a42-b054-e6a722e34750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:24.365532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f35495-9acc-4a42-b054-e6a722e34750 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:24.458569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:24.459445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:24.459729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:24.460006 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] PATH_INFO: `/v3/users/0e88a07bf9ae4a5f9b8aa69dacf62cda` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:24.482334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e88a07bf9ae4a5f9b8aa69dacf62cda)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:24.483416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:09:24.483416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: warnings.warn(msg) Jul 11 14:09:24.483416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: Jul 11 14:09:24.484679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:24.495002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:24.549877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e88a07bf9ae4a5f9b8aa69dacf62cda'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:09:24.550480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e88a07bf9ae4a5f9b8aa69dacf62cda'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:09:24.550912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e88a07bf9ae4a5f9b8aa69dacf62cda'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:09:24.563320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e88a07bf9ae4a5f9b8aa69dacf62cda'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:09:24.582532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e88a07bf9ae4a5f9b8aa69dacf62cda'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:09:24.597712 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 745/1507] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:09:24 2022] DELETE /identity/v3/users/0e88a07bf9ae4a5f9b8aa69dacf62cda => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:09:24.602263 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1624e-1a46-419e-bfdd-9f40d577f406 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:24.602465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1624e-1a46-419e-bfdd-9f40d577f406 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:24.602743 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1624e-1a46-419e-bfdd-9f40d577f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:24.660332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e1c1624e-1a46-419e-bfdd-9f40d577f406 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:09:24.661554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e1c1624e-1a46-419e-bfdd-9f40d577f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:24.738034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:24.751638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 763/1508] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:09:24.761548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:24.763067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:24.870303 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0a369-c0b8-4e89-85aa-5ac6dff1594b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:24.925542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:24.946819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabac2f-13f4-4c41-ab09-465595862949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:24.947477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabac2f-13f4-4c41-ab09-465595862949 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:24.947766 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabac2f-13f4-4c41-ab09-465595862949 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:24.948044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabac2f-13f4-4c41-ab09-465595862949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:24.949750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cdabac2f-13f4-4c41-ab09-465595862949 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:25.057497 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabac2f-13f4-4c41-ab09-465595862949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:25.058981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabac2f-13f4-4c41-ab09-465595862949 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:25.077387 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 746/1509] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:09:25.429259 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1624e-1a46-419e-bfdd-9f40d577f406 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:09:25.430655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e1c1624e-1a46-419e-bfdd-9f40d577f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:09:25.443184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1624e-1a46-419e-bfdd-9f40d577f406 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:09:25.542353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:09:25.543220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:09:25.543506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:09:25.543782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] PATH_INFO: `/v3/projects/c75b5933024849a994b5b2c98e293c7c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:09:25.553959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75b5933024849a994b5b2c98e293c7c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:09:25.555037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:09:25.555037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: warnings.warn(msg) Jul 11 14:09:25.555037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: Jul 11 14:09:25.556246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:09:25.616195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75b5933024849a994b5b2c98e293c7c', 'request_id': 'req-12802899-13ee-47b0-98b8-a074ed31d745'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:09:25.629883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75b5933024849a994b5b2c98e293c7c', 'request_id': 'req-12802899-13ee-47b0-98b8-a074ed31d745'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:09:25.635971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75b5933024849a994b5b2c98e293c7c', 'request_id': 'req-12802899-13ee-47b0-98b8-a074ed31d745'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:09:25.662416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] The token cache is being invalidate because project c75b5933024849a994b5b2c98e293c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:09:25.662709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:09:25.663139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-12802899-13ee-47b0-98b8-a074ed31d745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:09:25.664621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 764/1510] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:09:25 2022] DELETE /identity/v3/projects/c75b5933024849a994b5b2c98e293c7c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:09:35.075175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=62 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:09:35.660372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:09.590212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaede47-a4d4-4564-957e-8ca485a51b82 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:09.590794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaede47-a4d4-4564-957e-8ca485a51b82 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:09.590794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaede47-a4d4-4564-957e-8ca485a51b82 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:09.592109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:11:09.597038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d41d9c-0492-4f0c-b3bb-bf02ea16a0ef None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:09.597506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d41d9c-0492-4f0c-b3bb-bf02ea16a0ef None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:09.597616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d41d9c-0492-4f0c-b3bb-bf02ea16a0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:09.679227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-72d41d9c-0492-4f0c-b3bb-bf02ea16a0ef None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:09.680459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-72d41d9c-0492-4f0c-b3bb-bf02ea16a0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:09.787612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:09.944249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaede47-a4d4-4564-957e-8ca485a51b82 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:09.946439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-abaede47-a4d4-4564-957e-8ca485a51b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:10.068377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaede47-a4d4-4564-957e-8ca485a51b82 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:10.073884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e34da-e7b5-4831-8fa8-a37c38e940cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:10.075190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e34da-e7b5-4831-8fa8-a37c38e940cd service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:10.075566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e34da-e7b5-4831-8fa8-a37c38e940cd service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:10.075776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e34da-e7b5-4831-8fa8-a37c38e940cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:10.084118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e34da-e7b5-4831-8fa8-a37c38e940cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:10.085740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e34da-e7b5-4831-8fa8-a37c38e940cd service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:10.096267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 748/1513] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:11:10.974497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d1d1b-af81-48b4-9896-017d18f79cdf None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:10.975040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d1d1b-af81-48b4-9896-017d18f79cdf None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:10.975040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d1d1b-af81-48b4-9896-017d18f79cdf None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:10.976435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:11:10.982219 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a6d39-9f00-413c-a0ed-5b951e738e0c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:10.982662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a6d39-9f00-413c-a0ed-5b951e738e0c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:10.982763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a6d39-9f00-413c-a0ed-5b951e738e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:11.001284 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7c4a6d39-9f00-413c-a0ed-5b951e738e0c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:11.002532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7c4a6d39-9f00-413c-a0ed-5b951e738e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:11.010836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:11.178728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d1d1b-af81-48b4-9896-017d18f79cdf None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:11.193943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d1d1b-af81-48b4-9896-017d18f79cdf None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:11.200581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd21bc-11e5-439f-a866-16231f049c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:11.201250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd21bc-11e5-439f-a866-16231f049c46 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:11.201542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd21bc-11e5-439f-a866-16231f049c46 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:11.201825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd21bc-11e5-439f-a866-16231f049c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:11.212265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd21bc-11e5-439f-a866-16231f049c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:11.213953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd21bc-11e5-439f-a866-16231f049c46 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:11.225139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 767/1516] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:11:11.243274 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c0732-7cc3-43ca-ba8d-ffa113367a70 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:11.243568 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c0732-7cc3-43ca-ba8d-ffa113367a70 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:11.243874 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c0732-7cc3-43ca-ba8d-ffa113367a70 None None] PATH_INFO: `/v3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:11.245177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 750/1517] 10.222.0.17 () {54 vars in 925 bytes} [Mon Jul 11 14:11:11 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:11:11.251965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4713414-1840-49a6-b3ba-2d32248f5a50 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:11.252330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4713414-1840-49a6-b3ba-2d32248f5a50 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:11.252680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4713414-1840-49a6-b3ba-2d32248f5a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:11.320083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e4713414-1840-49a6-b3ba-2d32248f5a50 None None] MFA Rules not processed for user `2949783e08504cfba3dc52dcf8b6a015`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:11.321345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e4713414-1840-49a6-b3ba-2d32248f5a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:11.340410 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:11.396132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 768/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Jul 11 14:11:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:20.292302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa25a-6efe-48ed-8499-873841951125 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:20.292859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa25a-6efe-48ed-8499-873841951125 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:20.292859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aa25a-6efe-48ed-8499-873841951125 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:20.294506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 751/1519] 10.222.0.66 () {54 vars in 960 bytes} [Mon Jul 11 14:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:11:20.299590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09803453-391e-46e5-8d2f-58fe51915692 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:20.300007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09803453-391e-46e5-8d2f-58fe51915692 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:20.300157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09803453-391e-46e5-8d2f-58fe51915692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:20.318838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-09803453-391e-46e5-8d2f-58fe51915692 None None] MFA Rules not processed for user `2949783e08504cfba3dc52dcf8b6a015`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:20.320094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-09803453-391e-46e5-8d2f-58fe51915692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:20.329447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 769/1520] 10.222.0.66 () {58 vars in 1057 bytes} [Mon Jul 11 14:11:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:20.336914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aa25a-6efe-48ed-8499-873841951125 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:20.351369 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aa25a-6efe-48ed-8499-873841951125 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:20.356377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee83d16-f78c-4862-a2fc-cf451d845d44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:20.357019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83d16-f78c-4862-a2fc-cf451d845d44 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:20.357304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83d16-f78c-4862-a2fc-cf451d845d44 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:20.357581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83d16-f78c-4862-a2fc-cf451d845d44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:20.365966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee83d16-f78c-4862-a2fc-cf451d845d44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:20.367597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee83d16-f78c-4862-a2fc-cf451d845d44 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:20.377775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 752/1521] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:11:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:11:22.463493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2e3ac-f39a-466c-b2b5-98d6e06ec554 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:22.464227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2e3ac-f39a-466c-b2b5-98d6e06ec554 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:22.464227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2e3ac-f39a-466c-b2b5-98d6e06ec554 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:22.465497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:11:22.470268 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b0d75-be79-4c6c-9dca-e5848b219904 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:22.470697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b0d75-be79-4c6c-9dca-e5848b219904 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:22.470824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b0d75-be79-4c6c-9dca-e5848b219904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:22.489122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ab5b0d75-be79-4c6c-9dca-e5848b219904 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:22.490363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ab5b0d75-be79-4c6c-9dca-e5848b219904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:22.499131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:22.654368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2e3ac-f39a-466c-b2b5-98d6e06ec554 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:22.669912 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2e3ac-f39a-466c-b2b5-98d6e06ec554 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:22.675475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52185b5-b459-4960-86de-2e91be7f0e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:22.676127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52185b5-b459-4960-86de-2e91be7f0e93 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:22.676413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52185b5-b459-4960-86de-2e91be7f0e93 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:22.676693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52185b5-b459-4960-86de-2e91be7f0e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:22.685435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52185b5-b459-4960-86de-2e91be7f0e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:22.687056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52185b5-b459-4960-86de-2e91be7f0e93 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:22.696440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 771/1524] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:11:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:11:23.533623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027ee24-2f79-4173-a80b-2dea43bca79e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:23.534149 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027ee24-2f79-4173-a80b-2dea43bca79e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:23.534149 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027ee24-2f79-4173-a80b-2dea43bca79e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:23.535529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 11 14:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:11:23.541267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a4ce-777a-4f09-8a2e-6bc1148bbbe4 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:23.541710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a4ce-777a-4f09-8a2e-6bc1148bbbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:23.541853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290a4ce-777a-4f09-8a2e-6bc1148bbbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:23.565564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1290a4ce-777a-4f09-8a2e-6bc1148bbbe4 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:23.566822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1290a4ce-777a-4f09-8a2e-6bc1148bbbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:23.575723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 11 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:23.733761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027ee24-2f79-4173-a80b-2dea43bca79e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:23.748390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027ee24-2f79-4173-a80b-2dea43bca79e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:23.753816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4799d-9730-4363-890c-5911b1d30f4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:23.754479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4799d-9730-4363-890c-5911b1d30f4e service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:23.754767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4799d-9730-4363-890c-5911b1d30f4e service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:23.755046 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4799d-9730-4363-890c-5911b1d30f4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:23.764327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4799d-9730-4363-890c-5911b1d30f4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:23.765928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4799d-9730-4363-890c-5911b1d30f4e service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:23.775387 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 755/1527] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:11:27.834451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08e6a7-7850-4947-ab4b-97eb65923817 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:27.835046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08e6a7-7850-4947-ab4b-97eb65923817 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:27.835046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08e6a7-7850-4947-ab4b-97eb65923817 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:27.836380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:11:27.841863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a83804-5b34-4d61-8a6f-6004ba3ce1d0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:27.842335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a83804-5b34-4d61-8a6f-6004ba3ce1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:27.842487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a83804-5b34-4d61-8a6f-6004ba3ce1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:27.860922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-47a83804-5b34-4d61-8a6f-6004ba3ce1d0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:27.862657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-47a83804-5b34-4d61-8a6f-6004ba3ce1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:27.873806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:27.949547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08e6a7-7850-4947-ab4b-97eb65923817 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:27.951924 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fc08e6a7-7850-4947-ab4b-97eb65923817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:28.029139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08e6a7-7850-4947-ab4b-97eb65923817 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:28.032738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0c9eb-07ed-45ef-8172-00ef0c7da4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:28.033387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0c9eb-07ed-45ef-8172-00ef0c7da4df service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:28.033678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0c9eb-07ed-45ef-8172-00ef0c7da4df service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:28.033964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0c9eb-07ed-45ef-8172-00ef0c7da4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:28.043090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0c9eb-07ed-45ef-8172-00ef0c7da4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:28.045113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0c9eb-07ed-45ef-8172-00ef0c7da4df service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:28.054704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 774/1530] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:11:30.116619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3b47-498e-41d6-9d43-d201fffe8521 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:30.117211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3b47-498e-41d6-9d43-d201fffe8521 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:30.117211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c3b47-498e-41d6-9d43-d201fffe8521 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:30.118599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:11:30.123892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5030e-fc18-4202-8ce8-07e760ec44f0 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:30.124299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5030e-fc18-4202-8ce8-07e760ec44f0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:30.124490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5030e-fc18-4202-8ce8-07e760ec44f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:30.142620 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-bcb5030e-fc18-4202-8ce8-07e760ec44f0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:30.143812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-bcb5030e-fc18-4202-8ce8-07e760ec44f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:30.151562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:30.187964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c3b47-498e-41d6-9d43-d201fffe8521 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:30.199000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c3b47-498e-41d6-9d43-d201fffe8521 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:30.202959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f840-4ce8-482a-ab80-5abaa716997d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:30.203615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f840-4ce8-482a-ab80-5abaa716997d service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:30.203897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f840-4ce8-482a-ab80-5abaa716997d service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:30.204173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f840-4ce8-482a-ab80-5abaa716997d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:30.213927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968f840-4ce8-482a-ab80-5abaa716997d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:30.215428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968f840-4ce8-482a-ab80-5abaa716997d service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:30.226759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 758/1533] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:11:33.915478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623af9-7f7b-4c6c-a97a-95fdfe1ae6c1 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:33.916024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623af9-7f7b-4c6c-a97a-95fdfe1ae6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:33.916024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623af9-7f7b-4c6c-a97a-95fdfe1ae6c1 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:33.917464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:11:33.923567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052841-74aa-4dc3-97e4-b78f876a362b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:33.924028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052841-74aa-4dc3-97e4-b78f876a362b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:33.924125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052841-74aa-4dc3-97e4-b78f876a362b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:33.943248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8f052841-74aa-4dc3-97e4-b78f876a362b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:33.944487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8f052841-74aa-4dc3-97e4-b78f876a362b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:33.953715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:34.266610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623af9-7f7b-4c6c-a97a-95fdfe1ae6c1 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:34.268346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-61623af9-7f7b-4c6c-a97a-95fdfe1ae6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:34.347346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:34.363978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623af9-7f7b-4c6c-a97a-95fdfe1ae6c1 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:34.368340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79703f-cffc-47ea-b008-bca85753398e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:34.368987 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79703f-cffc-47ea-b008-bca85753398e service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:34.369268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79703f-cffc-47ea-b008-bca85753398e service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:34.369543 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79703f-cffc-47ea-b008-bca85753398e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:34.379320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79703f-cffc-47ea-b008-bca85753398e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:34.380753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79703f-cffc-47ea-b008-bca85753398e service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:34.391174 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 777/1536] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:11:36.532422 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922b65b-6836-488a-a4a3-2376c19e9642 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:36.532940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922b65b-6836-488a-a4a3-2376c19e9642 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:36.532940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922b65b-6836-488a-a4a3-2376c19e9642 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:36.534351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 11 14:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:11:36.542262 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99b196-3810-4da5-be3f-77be1b999829 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:36.542897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99b196-3810-4da5-be3f-77be1b999829 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:36.542897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99b196-3810-4da5-be3f-77be1b999829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:36.563044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ed99b196-3810-4da5-be3f-77be1b999829 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:11:36.564266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ed99b196-3810-4da5-be3f-77be1b999829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:36.572281 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 11 14:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:11:36.878732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922b65b-6836-488a-a4a3-2376c19e9642 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:11:36.880426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1922b65b-6836-488a-a4a3-2376c19e9642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:11:36.888313 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=84 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:36.894619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922b65b-6836-488a-a4a3-2376c19e9642 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:11:36.898139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e82de9-97f0-41b5-8e5b-b0a951387678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:11:36.898761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82de9-97f0-41b5-8e5b-b0a951387678 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:11:36.899041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82de9-97f0-41b5-8e5b-b0a951387678 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:11:36.899313 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82de9-97f0-41b5-8e5b-b0a951387678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:11:36.909187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e82de9-97f0-41b5-8e5b-b0a951387678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:11:36.910671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e82de9-97f0-41b5-8e5b-b0a951387678 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:11:36.920908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 761/1539] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:11:46.557522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=11 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:11:46.915999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:09.506945 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7cb7b-1973-49fb-b7e2-dbf999d80064 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:09.507564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7cb7b-1973-49fb-b7e2-dbf999d80064 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:09.507564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7cb7b-1973-49fb-b7e2-dbf999d80064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:09.534420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-14e7cb7b-1973-49fb-b7e2-dbf999d80064 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:09.535789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-14e7cb7b-1973-49fb-b7e2-dbf999d80064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:09.550238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 779/1540] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:09.558974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f0dc2-db3e-46ae-a62e-593f6bd14fe1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:09.559960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f0dc2-db3e-46ae-a62e-593f6bd14fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:09.560585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f0dc2-db3e-46ae-a62e-593f6bd14fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:09.592093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-1e3f0dc2-db3e-46ae-a62e-593f6bd14fe1 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:09.593338 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1e3f0dc2-db3e-46ae-a62e-593f6bd14fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:09.612032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 762/1541] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:09.617061 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7cb7b-1973-49fb-b7e2-dbf999d80064 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:09.632396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7cb7b-1973-49fb-b7e2-dbf999d80064 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:09.640845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6561b1-05c0-4168-bf48-ccb06b8ede25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:09.641558 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6561b1-05c0-4168-bf48-ccb06b8ede25 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:09.641847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6561b1-05c0-4168-bf48-ccb06b8ede25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:09.642132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6561b1-05c0-4168-bf48-ccb06b8ede25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:09.642945 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6561b1-05c0-4168-bf48-ccb06b8ede25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:09.643257 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6561b1-05c0-4168-bf48-ccb06b8ede25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:09.644972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6561b1-05c0-4168-bf48-ccb06b8ede25 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:09.668854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 780/1542] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:09.683416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f0dc2-db3e-46ae-a62e-593f6bd14fe1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:09.693564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f0dc2-db3e-46ae-a62e-593f6bd14fe1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:09.706270 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79630d-0454-4a74-b3d7-f01b54d9d569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:09.706966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79630d-0454-4a74-b3d7-f01b54d9d569 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:09.707247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79630d-0454-4a74-b3d7-f01b54d9d569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:09.707521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79630d-0454-4a74-b3d7-f01b54d9d569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:09.708242 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79630d-0454-4a74-b3d7-f01b54d9d569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:09.710217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79630d-0454-4a74-b3d7-f01b54d9d569 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:09.774553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 763/1543] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:09 2022] POST /identity/v3/projects => generated 355 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:13:09.778882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6561b1-05c0-4168-bf48-ccb06b8ede25 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:09.793020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6561b1-05c0-4168-bf48-ccb06b8ede25 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:09.873063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adeb5e-1ea3-4fd3-a9ec-3baf3d3f0c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:09.873787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adeb5e-1ea3-4fd3-a9ec-3baf3d3f0c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:09.874080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adeb5e-1ea3-4fd3-a9ec-3baf3d3f0c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:09.874452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adeb5e-1ea3-4fd3-a9ec-3baf3d3f0c3f admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:09.875106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adeb5e-1ea3-4fd3-a9ec-3baf3d3f0c3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:09.877118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adeb5e-1ea3-4fd3-a9ec-3baf3d3f0c3f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:09.903380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 781/1544] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:09 2022] POST /identity/v3/users => generated 278 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:09.907394 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79630d-0454-4a74-b3d7-f01b54d9d569 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:09.922410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79630d-0454-4a74-b3d7-f01b54d9d569 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:09.929471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96a072-1cf7-4d4f-ad32-78d671cc7b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:09.930190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96a072-1cf7-4d4f-ad32-78d671cc7b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:09.930475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96a072-1cf7-4d4f-ad32-78d671cc7b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:09.930758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96a072-1cf7-4d4f-ad32-78d671cc7b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:09.931491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96a072-1cf7-4d4f-ad32-78d671cc7b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:09.933854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96a072-1cf7-4d4f-ad32-78d671cc7b46 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:09.949915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 764/1545] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:09.954190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adeb5e-1ea3-4fd3-a9ec-3baf3d3f0c3f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:09.972244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adeb5e-1ea3-4fd3-a9ec-3baf3d3f0c3f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:09.980960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69254-4d1a-4166-9c6c-2a0dab2d2f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:09.981662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69254-4d1a-4166-9c6c-2a0dab2d2f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:09.981948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69254-4d1a-4166-9c6c-2a0dab2d2f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:09.982254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c69254-4d1a-4166-9c6c-2a0dab2d2f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:09.983001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c69254-4d1a-4166-9c6c-2a0dab2d2f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:09.984770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c69254-4d1a-4166-9c6c-2a0dab2d2f8e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:09.987838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79879834-c825-43f3-9fb1-e063ff906804 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:09.988129 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79879834-c825-43f3-9fb1-e063ff906804 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:09.988406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79879834-c825-43f3-9fb1-e063ff906804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.009271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 782/1546] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:10.016736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69254-4d1a-4166-9c6c-2a0dab2d2f8e admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.030096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-79879834-c825-43f3-9fb1-e063ff906804 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.031261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-79879834-c825-43f3-9fb1-e063ff906804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.035378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c69254-4d1a-4166-9c6c-2a0dab2d2f8e admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.044556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632cff7-e958-4c5a-ab84-01d98c9596c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.045480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632cff7-e958-4c5a-ab84-01d98c9596c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.045765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632cff7-e958-4c5a-ab84-01d98c9596c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.046048 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632cff7-e958-4c5a-ab84-01d98c9596c7 admin admin] PATH_INFO: `/v3/projects/57fb45f23b174649b0fb9e73033218fb/users/83033c72de2f41738358a9a5f161b3c5/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.049425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 765/1547] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.060139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a37679-aa24-4d0d-806b-6a6161ee7d4d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.060464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a37679-aa24-4d0d-806b-6a6161ee7d4d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.060704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a37679-aa24-4d0d-806b-6a6161ee7d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.094809 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632cff7-e958-4c5a-ab84-01d98c9596c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57fb45f23b174649b0fb9e73033218fb, user_id=83033c72de2f41738358a9a5f161b3c5, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.095873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-8632cff7-e958-4c5a-ab84-01d98c9596c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:13:10.095873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: warnings.warn(msg) Jul 11 14:13:10.095873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: Jul 11 14:13:10.098013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632cff7-e958-4c5a-ab84-01d98c9596c7 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.101331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-99a37679-aa24-4d0d-806b-6a6161ee7d4d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.104170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-99a37679-aa24-4d0d-806b-6a6161ee7d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.116401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 766/1548] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.120547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437553-0f55-4040-ac7f-16056bf7fde0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.121140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437553-0f55-4040-ac7f-16056bf7fde0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.121645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66437553-0f55-4040-ac7f-16056bf7fde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.131705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 783/1549] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:10 2022] PUT /identity/v3/projects/57fb45f23b174649b0fb9e73033218fb/users/83033c72de2f41738358a9a5f161b3c5/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:10.131705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada9aac-67a6-414d-98d9-c1946353bcfe None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.132222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada9aac-67a6-414d-98d9-c1946353bcfe None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.132403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada9aac-67a6-414d-98d9-c1946353bcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.151712 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-66437553-0f55-4040-ac7f-16056bf7fde0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.153210 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-66437553-0f55-4040-ac7f-16056bf7fde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.175388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4ada9aac-67a6-414d-98d9-c1946353bcfe None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.177776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4ada9aac-67a6-414d-98d9-c1946353bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.259095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 767/1550] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.260647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61452-7236-4b45-9ada-c2a61375eda1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.260944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61452-7236-4b45-9ada-c2a61375eda1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.261221 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc61452-7236-4b45-9ada-c2a61375eda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.275547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 784/1551] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.277302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada9aac-67a6-414d-98d9-c1946353bcfe None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.280371 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4bc61452-7236-4b45-9ada-c2a61375eda1 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.281514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4bc61452-7236-4b45-9ada-c2a61375eda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.288724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada9aac-67a6-414d-98d9-c1946353bcfe None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.290560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 768/1552] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.292741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e487851-69da-49d8-99cd-9e46c38bf851 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.293036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e487851-69da-49d8-99cd-9e46c38bf851 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.293303 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e487851-69da-49d8-99cd-9e46c38bf851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.295524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e7e86-ff89-43f4-bda1-e77ed2a2c8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.296620 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7e86-ff89-43f4-bda1-e77ed2a2c8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.296920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7e86-ff89-43f4-bda1-e77ed2a2c8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.297202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7e86-ff89-43f4-bda1-e77ed2a2c8b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.297944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e7e86-ff89-43f4-bda1-e77ed2a2c8b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:10.298604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e7e86-ff89-43f4-bda1-e77ed2a2c8b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.301540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e7e86-ff89-43f4-bda1-e77ed2a2c8b1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.316323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 785/1553] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:10.317505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824881d-6667-43f3-8a28-0e132a5aca7a None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.317803 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824881d-6667-43f3-8a28-0e132a5aca7a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.318083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824881d-6667-43f3-8a28-0e132a5aca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.321285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9e487851-69da-49d8-99cd-9e46c38bf851 None None] MFA Rules not processed for user `83033c72de2f41738358a9a5f161b3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.322806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9e487851-69da-49d8-99cd-9e46c38bf851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.338393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4824881d-6667-43f3-8a28-0e132a5aca7a None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.339650 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4824881d-6667-43f3-8a28-0e132a5aca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.349822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 786/1554] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.351193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bc3f-a59e-4be7-a51b-319ea32afeeb None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.351488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bc3f-a59e-4be7-a51b-319ea32afeeb None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.351777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065bc3f-a59e-4be7-a51b-319ea32afeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.375132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b065bc3f-a59e-4be7-a51b-319ea32afeeb None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.376347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b065bc3f-a59e-4be7-a51b-319ea32afeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.385057 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 787/1555] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.386343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f164f3-1f23-4875-80ec-e04b4f389f24 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.386641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f164f3-1f23-4875-80ec-e04b4f389f24 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.386930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f164f3-1f23-4875-80ec-e04b4f389f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.405188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-32f164f3-1f23-4875-80ec-e04b4f389f24 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.405398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 769/1556] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.406438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-32f164f3-1f23-4875-80ec-e04b4f389f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.406741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d311a-1818-42a8-92ee-ab990dbabf4f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.407065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d311a-1818-42a8-92ee-ab990dbabf4f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.407345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d311a-1818-42a8-92ee-ab990dbabf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.416885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 788/1557] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.418016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b677a-1ea7-44d1-9bb0-a20432141b92 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.418493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b677a-1ea7-44d1-9bb0-a20432141b92 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.418787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b677a-1ea7-44d1-9bb0-a20432141b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.425390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:10.426658 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-397d311a-1818-42a8-92ee-ab990dbabf4f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.428060 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-397d311a-1818-42a8-92ee-ab990dbabf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.437050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 770/1558] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.438378 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f307-3045-4518-8ee2-fad730517975 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.438937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f307-3045-4518-8ee2-fad730517975 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.439226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49f307-3045-4518-8ee2-fad730517975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.439705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-142b677a-1ea7-44d1-9bb0-a20432141b92 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.441157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-142b677a-1ea7-44d1-9bb0-a20432141b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.449328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 789/1559] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.450799 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b677a-1ea7-44d1-9bb0-a20432141b92 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.458393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5b49f307-3045-4518-8ee2-fad730517975 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.459607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5b49f307-3045-4518-8ee2-fad730517975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.461084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b677a-1ea7-44d1-9bb0-a20432141b92 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.466524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d5743-e069-4810-a22b-7f8da69eb844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.467189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5743-e069-4810-a22b-7f8da69eb844 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.467477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5743-e069-4810-a22b-7f8da69eb844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.467763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d5743-e069-4810-a22b-7f8da69eb844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.468452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 771/1560] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.468595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d5743-e069-4810-a22b-7f8da69eb844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.469560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-d76d5743-e069-4810-a22b-7f8da69eb844 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:13:10.469560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: warnings.warn(msg) Jul 11 14:13:10.469560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: Jul 11 14:13:10.469813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b458-b0eb-4424-888a-962636850d80 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.470023 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b458-b0eb-4424-888a-962636850d80 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.470334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6b458-b0eb-4424-888a-962636850d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.470797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d5743-e069-4810-a22b-7f8da69eb844 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.491211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ebe6b458-b0eb-4424-888a-962636850d80 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.492276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ebe6b458-b0eb-4424-888a-962636850d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.501357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 772/1561] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.502729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c6688-b325-4d8b-86a1-ad891972e0f3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.503020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c6688-b325-4d8b-86a1-ad891972e0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.503299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c6688-b325-4d8b-86a1-ad891972e0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.503401 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 790/1562] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:10.504241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d5743-e069-4810-a22b-7f8da69eb844 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.511943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:10.528913 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a44c6688-b325-4d8b-86a1-ad891972e0f3 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.530136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a44c6688-b325-4d8b-86a1-ad891972e0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.578314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d5743-e069-4810-a22b-7f8da69eb844 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.583440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb604d2c-205a-4a98-ad02-d7f8215fa656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.584109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb604d2c-205a-4a98-ad02-d7f8215fa656 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.584395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb604d2c-205a-4a98-ad02-d7f8215fa656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.584677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb604d2c-205a-4a98-ad02-d7f8215fa656 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.586389 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb604d2c-205a-4a98-ad02-d7f8215fa656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.588827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb604d2c-205a-4a98-ad02-d7f8215fa656 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.591906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 773/1563] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.592951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c6688-b325-4d8b-86a1-ad891972e0f3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.603152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c6688-b325-4d8b-86a1-ad891972e0f3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.609445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c260d99-6e15-4cc7-9382-4fd139f595c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.610256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c260d99-6e15-4cc7-9382-4fd139f595c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.610598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c260d99-6e15-4cc7-9382-4fd139f595c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.610902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c260d99-6e15-4cc7-9382-4fd139f595c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.611789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c260d99-6e15-4cc7-9382-4fd139f595c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:10.612095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c260d99-6e15-4cc7-9382-4fd139f595c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.613207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-3c260d99-6e15-4cc7-9382-4fd139f595c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:13:10.613207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: warnings.warn(msg) Jul 11 14:13:10.613207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: Jul 11 14:13:10.614218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c260d99-6e15-4cc7-9382-4fd139f595c0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.621501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 791/1564] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/projects => generated 353 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:10.622505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb604d2c-205a-4a98-ad02-d7f8215fa656 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.637491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 774/1565] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:10.638450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c260d99-6e15-4cc7-9382-4fd139f595c0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.651737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c260d99-6e15-4cc7-9382-4fd139f595c0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.700715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb604d2c-205a-4a98-ad02-d7f8215fa656 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.706005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8d50f-756a-4779-8129-a8413282df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.707024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8d50f-756a-4779-8129-a8413282df28 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.707459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8d50f-756a-4779-8129-a8413282df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.707880 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8d50f-756a-4779-8129-a8413282df28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.709023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8d50f-756a-4779-8129-a8413282df28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:10.709497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8d50f-756a-4779-8129-a8413282df28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.712223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8d50f-756a-4779-8129-a8413282df28 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.720662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38fd1a-eb68-43cf-873a-9306ed7e753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.721330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38fd1a-eb68-43cf-873a-9306ed7e753d admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.721611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38fd1a-eb68-43cf-873a-9306ed7e753d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.722005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38fd1a-eb68-43cf-873a-9306ed7e753d admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.722766 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38fd1a-eb68-43cf-873a-9306ed7e753d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:10.723076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38fd1a-eb68-43cf-873a-9306ed7e753d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.724678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38fd1a-eb68-43cf-873a-9306ed7e753d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.726779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 792/1566] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:10.728955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bf162-282c-438f-aa0d-7e52fc10eb30 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.729455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bf162-282c-438f-aa0d-7e52fc10eb30 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.730077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9bf162-282c-438f-aa0d-7e52fc10eb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.738068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 775/1567] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:10.738930 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38fd1a-eb68-43cf-873a-9306ed7e753d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.749349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38fd1a-eb68-43cf-873a-9306ed7e753d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.753944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f089918-ff21-4a9b-bbdf-e2c8d34793f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.754650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f089918-ff21-4a9b-bbdf-e2c8d34793f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.754935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f089918-ff21-4a9b-bbdf-e2c8d34793f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.755213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f089918-ff21-4a9b-bbdf-e2c8d34793f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.755900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f089918-ff21-4a9b-bbdf-e2c8d34793f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.756924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-2f089918-ff21-4a9b-bbdf-e2c8d34793f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:13:10.756924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: warnings.warn(msg) Jul 11 14:13:10.756924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: Jul 11 14:13:10.758467 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f089918-ff21-4a9b-bbdf-e2c8d34793f7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.760636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-be9bf162-282c-438f-aa0d-7e52fc10eb30 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:10.761860 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-be9bf162-282c-438f-aa0d-7e52fc10eb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:10.770861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 793/1568] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:10.771912 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bf162-282c-438f-aa0d-7e52fc10eb30 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.782134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9bf162-282c-438f-aa0d-7e52fc10eb30 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.783968 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 776/1569] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:10.784730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f089918-ff21-4a9b-bbdf-e2c8d34793f7 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.787514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d79bb8-189a-4d2a-92e6-bc4f80d2247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.788257 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d79bb8-189a-4d2a-92e6-bc4f80d2247f admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.788620 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d79bb8-189a-4d2a-92e6-bc4f80d2247f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.788973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d79bb8-189a-4d2a-92e6-bc4f80d2247f admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.789794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d79bb8-189a-4d2a-92e6-bc4f80d2247f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:10.790201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d79bb8-189a-4d2a-92e6-bc4f80d2247f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.792746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d79bb8-189a-4d2a-92e6-bc4f80d2247f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.795393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f089918-ff21-4a9b-bbdf-e2c8d34793f7 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.800020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019db5ec-6370-4d4d-b815-c3088000e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.800706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019db5ec-6370-4d4d-b815-c3088000e063 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.800991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019db5ec-6370-4d4d-b815-c3088000e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.801267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019db5ec-6370-4d4d-b815-c3088000e063 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.802001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019db5ec-6370-4d4d-b815-c3088000e063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:10.802338 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019db5ec-6370-4d4d-b815-c3088000e063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.803936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019db5ec-6370-4d4d-b815-c3088000e063 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.804999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 794/1570] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:10.805875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d79bb8-189a-4d2a-92e6-bc4f80d2247f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.816781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d79bb8-189a-4d2a-92e6-bc4f80d2247f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.821446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e3890-7151-4bbf-85b8-c40faccb2c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.822146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 777/1571] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:10.822317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e3890-7151-4bbf-85b8-c40faccb2c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.822589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e3890-7151-4bbf-85b8-c40faccb2c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.822945 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e3890-7151-4bbf-85b8-c40faccb2c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.823113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019db5ec-6370-4d4d-b815-c3088000e063 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.823646 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e3890-7151-4bbf-85b8-c40faccb2c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.825575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e3890-7151-4bbf-85b8-c40faccb2c59 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.832975 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019db5ec-6370-4d4d-b815-c3088000e063 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.837651 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498301bc-59c7-4942-aa91-b900f2e0497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.838473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498301bc-59c7-4942-aa91-b900f2e0497b admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.838761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498301bc-59c7-4942-aa91-b900f2e0497b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.839038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498301bc-59c7-4942-aa91-b900f2e0497b admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.840099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498301bc-59c7-4942-aa91-b900f2e0497b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.842423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498301bc-59c7-4942-aa91-b900f2e0497b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.850978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 795/1572] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:10.850978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e3890-7151-4bbf-85b8-c40faccb2c59 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.859382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e3890-7151-4bbf-85b8-c40faccb2c59 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.866331 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc1b97-de25-4c60-96ba-edb4883e9f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.867118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc1b97-de25-4c60-96ba-edb4883e9f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.867481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc1b97-de25-4c60-96ba-edb4883e9f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.867846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc1b97-de25-4c60-96ba-edb4883e9f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.868537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc1b97-de25-4c60-96ba-edb4883e9f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.871440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc1b97-de25-4c60-96ba-edb4883e9f1f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.876549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 778/1573] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:10.876549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498301bc-59c7-4942-aa91-b900f2e0497b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.886407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:10.903600 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 796/1574] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:10.903600 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc1b97-de25-4c60-96ba-edb4883e9f1f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:10.909599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:10.941736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498301bc-59c7-4942-aa91-b900f2e0497b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.968783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc1b97-de25-4c60-96ba-edb4883e9f1f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:10.973475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2625f94-883e-4cb4-a38a-405a5a3996de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:10.974148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625f94-883e-4cb4-a38a-405a5a3996de admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:10.974485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625f94-883e-4cb4-a38a-405a5a3996de admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:10.974778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2625f94-883e-4cb4-a38a-405a5a3996de admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:10.975520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2625f94-883e-4cb4-a38a-405a5a3996de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:10.975833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2625f94-883e-4cb4-a38a-405a5a3996de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:10.977449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2625f94-883e-4cb4-a38a-405a5a3996de admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:10.990467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 797/1575] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:10.991513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2625f94-883e-4cb4-a38a-405a5a3996de admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.001999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fbf97-5406-4168-930c-d2894a69b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.002759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fbf97-5406-4168-930c-d2894a69b168 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.003043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fbf97-5406-4168-930c-d2894a69b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.003315 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fbf97-5406-4168-930c-d2894a69b168 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.004015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fbf97-5406-4168-930c-d2894a69b168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.004164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2625f94-883e-4cb4-a38a-405a5a3996de admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.005930 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fbf97-5406-4168-930c-d2894a69b168 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.013916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a243e-69d7-4be8-bb3c-b1fb8078d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.014626 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a243e-69d7-4be8-bb3c-b1fb8078d05d admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.014920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a243e-69d7-4be8-bb3c-b1fb8078d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.015198 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a243e-69d7-4be8-bb3c-b1fb8078d05d admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.015937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a243e-69d7-4be8-bb3c-b1fb8078d05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.017758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a243e-69d7-4be8-bb3c-b1fb8078d05d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.034255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 798/1576] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.034255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a243e-69d7-4be8-bb3c-b1fb8078d05d admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.039780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 779/1577] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:10 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:11.040543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fbf97-5406-4168-930c-d2894a69b168 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.046143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a243e-69d7-4be8-bb3c-b1fb8078d05d admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.105593 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4a751-45d2-49ca-8cec-2f370247ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.106426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4a751-45d2-49ca-8cec-2f370247ac75 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.106556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fbf97-5406-4168-930c-d2894a69b168 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.106725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4a751-45d2-49ca-8cec-2f370247ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.107037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4a751-45d2-49ca-8cec-2f370247ac75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.107785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4a751-45d2-49ca-8cec-2f370247ac75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.109710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4a751-45d2-49ca-8cec-2f370247ac75 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.111248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d256f2-60ff-4531-9569-87df1e06a37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.111913 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d256f2-60ff-4531-9569-87df1e06a37d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.112193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d256f2-60ff-4531-9569-87df1e06a37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.112470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d256f2-60ff-4531-9569-87df1e06a37d admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.113167 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d256f2-60ff-4531-9569-87df1e06a37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.115115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d256f2-60ff-4531-9569-87df1e06a37d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.137633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 799/1578] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:11 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:11.138350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4a751-45d2-49ca-8cec-2f370247ac75 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.145636 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 780/1579] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:11 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:11.146885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d256f2-60ff-4531-9569-87df1e06a37d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.200191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:11.206750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4a751-45d2-49ca-8cec-2f370247ac75 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.213444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acd08d-24d9-4893-b38a-8060b2e1abf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.213650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d256f2-60ff-4531-9569-87df1e06a37d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.214511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acd08d-24d9-4893-b38a-8060b2e1abf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.214788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acd08d-24d9-4893-b38a-8060b2e1abf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.215060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acd08d-24d9-4893-b38a-8060b2e1abf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.215802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acd08d-24d9-4893-b38a-8060b2e1abf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.217411 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10acd08d-24d9-4893-b38a-8060b2e1abf0 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.219225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452b162-3ff2-4554-badd-ded904a0b247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.219888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b162-3ff2-4554-badd-ded904a0b247 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.220215 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b162-3ff2-4554-badd-ded904a0b247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.220488 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b162-3ff2-4554-badd-ded904a0b247 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.221174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452b162-3ff2-4554-badd-ded904a0b247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.223127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452b162-3ff2-4554-badd-ded904a0b247 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.223273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:11.233948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 800/1580] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.235171 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acd08d-24d9-4893-b38a-8060b2e1abf0 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.246349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acd08d-24d9-4893-b38a-8060b2e1abf0 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.251203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426e8e4-b82a-405d-9c7a-a4be9678800c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.251919 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426e8e4-b82a-405d-9c7a-a4be9678800c admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.252297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426e8e4-b82a-405d-9c7a-a4be9678800c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.252810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426e8e4-b82a-405d-9c7a-a4be9678800c admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.254022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426e8e4-b82a-405d-9c7a-a4be9678800c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.255877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426e8e4-b82a-405d-9c7a-a4be9678800c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.262040 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 781/1581] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:11 2022] POST /identity/v3/users => generated 302 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:11.262040 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452b162-3ff2-4554-badd-ded904a0b247 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.273601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452b162-3ff2-4554-badd-ded904a0b247 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.278267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 801/1582] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:11 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:11.279321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426e8e4-b82a-405d-9c7a-a4be9678800c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.279473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914635f-7378-4dc3-828c-46029e895294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.280136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914635f-7378-4dc3-828c-46029e895294 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.280417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914635f-7378-4dc3-828c-46029e895294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.280694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914635f-7378-4dc3-828c-46029e895294 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.281543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914635f-7378-4dc3-828c-46029e895294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.283508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914635f-7378-4dc3-828c-46029e895294 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.289567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426e8e4-b82a-405d-9c7a-a4be9678800c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.295325 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618cc76-6cff-4d1e-9e5f-a1d92eb4ed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.296007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618cc76-6cff-4d1e-9e5f-a1d92eb4ed3a admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.296392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618cc76-6cff-4d1e-9e5f-a1d92eb4ed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.296673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618cc76-6cff-4d1e-9e5f-a1d92eb4ed3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.297555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618cc76-6cff-4d1e-9e5f-a1d92eb4ed3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.299801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618cc76-6cff-4d1e-9e5f-a1d92eb4ed3a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.315244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 802/1583] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.315244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618cc76-6cff-4d1e-9e5f-a1d92eb4ed3a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.315988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 782/1584] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:11 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:11.316810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914635f-7378-4dc3-828c-46029e895294 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.323102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618cc76-6cff-4d1e-9e5f-a1d92eb4ed3a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.380579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ecc1a-3348-4ab7-9edd-0d3607ae1e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.381180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914635f-7378-4dc3-828c-46029e895294 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.381319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ecc1a-3348-4ab7-9edd-0d3607ae1e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.381553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ecc1a-3348-4ab7-9edd-0d3607ae1e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.381900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ecc1a-3348-4ab7-9edd-0d3607ae1e1e admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.382642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ecc1a-3348-4ab7-9edd-0d3607ae1e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.385319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ecc1a-3348-4ab7-9edd-0d3607ae1e1e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.386648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea659e3c-915b-4eb6-8f5e-feec297264a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.387401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea659e3c-915b-4eb6-8f5e-feec297264a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.387679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea659e3c-915b-4eb6-8f5e-feec297264a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.387949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea659e3c-915b-4eb6-8f5e-feec297264a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.388634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea659e3c-915b-4eb6-8f5e-feec297264a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.390570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea659e3c-915b-4eb6-8f5e-feec297264a1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.407300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 803/1585] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:11 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:11.408111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ecc1a-3348-4ab7-9edd-0d3607ae1e1e admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.418962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 783/1586] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:11 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:11.418962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea659e3c-915b-4eb6-8f5e-feec297264a1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.419242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ecc1a-3348-4ab7-9edd-0d3607ae1e1e admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.424187 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451ba2f-25a9-48b2-b517-e56e933f5184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.424857 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451ba2f-25a9-48b2-b517-e56e933f5184 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.425145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451ba2f-25a9-48b2-b517-e56e933f5184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.425418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451ba2f-25a9-48b2-b517-e56e933f5184 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.426114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451ba2f-25a9-48b2-b517-e56e933f5184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.426969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea659e3c-915b-4eb6-8f5e-feec297264a1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.428063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451ba2f-25a9-48b2-b517-e56e933f5184 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.432095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edee5b8-8655-4c3f-8b76-558d74e7a3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.433168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edee5b8-8655-4c3f-8b76-558d74e7a3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.433452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edee5b8-8655-4c3f-8b76-558d74e7a3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.433727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edee5b8-8655-4c3f-8b76-558d74e7a3f1 admin admin] PATH_INFO: `/v3/projects/a7b91db66c6c4c878815e1aac3bb0d59/users/008d38040625431d8dbbb50a87da99ae/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.449641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 804/1587] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:11 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:11.450420 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edee5b8-8655-4c3f-8b76-558d74e7a3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b91db66c6c4c878815e1aac3bb0d59, user_id=008d38040625431d8dbbb50a87da99ae, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.453393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edee5b8-8655-4c3f-8b76-558d74e7a3f1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.453522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451ba2f-25a9-48b2-b517-e56e933f5184 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.464375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451ba2f-25a9-48b2-b517-e56e933f5184 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.467826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 784/1588] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:11 2022] PUT /identity/v3/projects/a7b91db66c6c4c878815e1aac3bb0d59/users/008d38040625431d8dbbb50a87da99ae/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:11.468635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edee5b8-8655-4c3f-8b76-558d74e7a3f1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.525044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01058ad-b3f2-4d8c-aa13-6f7c3b5c97d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.526324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01058ad-b3f2-4d8c-aa13-6f7c3b5c97d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.526613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01058ad-b3f2-4d8c-aa13-6f7c3b5c97d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.526899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01058ad-b3f2-4d8c-aa13-6f7c3b5c97d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.527634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01058ad-b3f2-4d8c-aa13-6f7c3b5c97d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.529249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01058ad-b3f2-4d8c-aa13-6f7c3b5c97d2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.531063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edee5b8-8655-4c3f-8b76-558d74e7a3f1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.535943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c727099-746d-4a9f-ba65-a8b9a7aede9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.536737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c727099-746d-4a9f-ba65-a8b9a7aede9a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.537162 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c727099-746d-4a9f-ba65-a8b9a7aede9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.537315 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c727099-746d-4a9f-ba65-a8b9a7aede9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.538068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c727099-746d-4a9f-ba65-a8b9a7aede9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.539337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 805/1589] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.539952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c727099-746d-4a9f-ba65-a8b9a7aede9a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.540138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01058ad-b3f2-4d8c-aa13-6f7c3b5c97d2 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.549950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01058ad-b3f2-4d8c-aa13-6f7c3b5c97d2 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.554926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 785/1590] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.554926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c727099-746d-4a9f-ba65-a8b9a7aede9a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.555133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cee12-9924-4009-b0af-7591d169fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.555382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cee12-9924-4009-b0af-7591d169fa94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.555673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cee12-9924-4009-b0af-7591d169fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.555955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cee12-9924-4009-b0af-7591d169fa94 admin admin] PATH_INFO: `/v3/projects/15d95b0cae244d99885be229335ea541/users/39a5cea0a591453581a9d98ff796d973/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.562607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c727099-746d-4a9f-ba65-a8b9a7aede9a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.567550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf76c-d2d6-462c-bf20-607e98321dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.568839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf76c-d2d6-462c-bf20-607e98321dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.569120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf76c-d2d6-462c-bf20-607e98321dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.569396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf76c-d2d6-462c-bf20-607e98321dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.570126 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcf76c-d2d6-462c-bf20-607e98321dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.571479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cee12-9924-4009-b0af-7591d169fa94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d95b0cae244d99885be229335ea541, user_id=39a5cea0a591453581a9d98ff796d973, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.572751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcf76c-d2d6-462c-bf20-607e98321dd3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.574952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140cee12-9924-4009-b0af-7591d169fa94 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.589125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:11.589603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 806/1591] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:11 2022] PUT /identity/v3/projects/15d95b0cae244d99885be229335ea541/users/39a5cea0a591453581a9d98ff796d973/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:11.590623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cee12-9924-4009-b0af-7591d169fa94 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.596733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 786/1592] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:11 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:11.597671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf76c-d2d6-462c-bf20-607e98321dd3 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.607513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:11.609436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf76c-d2d6-462c-bf20-607e98321dd3 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.659732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cee12-9924-4009-b0af-7591d169fa94 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.664534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47821ff4-759e-48bb-96f5-83a67d8ef1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.665213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821ff4-759e-48bb-96f5-83a67d8ef1da admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.665506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821ff4-759e-48bb-96f5-83a67d8ef1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.665830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47821ff4-759e-48bb-96f5-83a67d8ef1da admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.666743 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47821ff4-759e-48bb-96f5-83a67d8ef1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.667078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bdc8b-df66-49e4-912d-65c28be76bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.667760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdc8b-df66-49e4-912d-65c28be76bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.668048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdc8b-df66-49e4-912d-65c28be76bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.668332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdc8b-df66-49e4-912d-65c28be76bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.668458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47821ff4-759e-48bb-96f5-83a67d8ef1da admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.669064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bdc8b-df66-49e4-912d-65c28be76bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.670711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bdc8b-df66-49e4-912d-65c28be76bdd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.683107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 807/1593] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.683107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47821ff4-759e-48bb-96f5-83a67d8ef1da admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.683405 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 787/1594] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.683405 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bdc8b-df66-49e4-912d-65c28be76bdd admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.692357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bdc8b-df66-49e4-912d-65c28be76bdd admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.693930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47821ff4-759e-48bb-96f5-83a67d8ef1da admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.697518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce5469-088b-40e5-8bb6-7fced026ea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.698231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce5469-088b-40e5-8bb6-7fced026ea6b admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.698516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce5469-088b-40e5-8bb6-7fced026ea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.698799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce5469-088b-40e5-8bb6-7fced026ea6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.699279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f50a3e-4dbe-481e-be94-74d152c67beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.699525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce5469-088b-40e5-8bb6-7fced026ea6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.699998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f50a3e-4dbe-481e-be94-74d152c67beb admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.700291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f50a3e-4dbe-481e-be94-74d152c67beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.700630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f50a3e-4dbe-481e-be94-74d152c67beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.701132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce5469-088b-40e5-8bb6-7fced026ea6b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.701364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f50a3e-4dbe-481e-be94-74d152c67beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.703011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f50a3e-4dbe-481e-be94-74d152c67beb admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.711423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 788/1595] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.712312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce5469-088b-40e5-8bb6-7fced026ea6b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.713631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 808/1596] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.714480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f50a3e-4dbe-481e-be94-74d152c67beb admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.724422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f50a3e-4dbe-481e-be94-74d152c67beb admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.726132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce5469-088b-40e5-8bb6-7fced026ea6b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.729560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998edda-a9aa-4e44-b42b-6653b85bfdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.730296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998edda-a9aa-4e44-b42b-6653b85bfdca admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.730590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998edda-a9aa-4e44-b42b-6653b85bfdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.730873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998edda-a9aa-4e44-b42b-6653b85bfdca admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.731289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8568d-aac6-49a0-9ff6-29430eda2d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.731608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998edda-a9aa-4e44-b42b-6653b85bfdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.731955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8568d-aac6-49a0-9ff6-29430eda2d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.732244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8568d-aac6-49a0-9ff6-29430eda2d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.732525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8568d-aac6-49a0-9ff6-29430eda2d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.733207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998edda-a9aa-4e44-b42b-6653b85bfdca admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.733324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8568d-aac6-49a0-9ff6-29430eda2d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.734959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8568d-aac6-49a0-9ff6-29430eda2d46 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.747670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 809/1597] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.747872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 789/1598] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.747969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ffb2-1b37-4fda-ac0b-fd9ad7dbb8fa None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.747969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ffb2-1b37-4fda-ac0b-fd9ad7dbb8fa None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.747969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ffb2-1b37-4fda-ac0b-fd9ad7dbb8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.749374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8568d-aac6-49a0-9ff6-29430eda2d46 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.759977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8568d-aac6-49a0-9ff6-29430eda2d46 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.764767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4d92ffb2-1b37-4fda-ac0b-fd9ad7dbb8fa None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:11.764991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c912d9-cf81-46e8-a64d-f45132a530f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.765611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c912d9-cf81-46e8-a64d-f45132a530f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.765893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c912d9-cf81-46e8-a64d-f45132a530f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.766188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c912d9-cf81-46e8-a64d-f45132a530f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.766502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4d92ffb2-1b37-4fda-ac0b-fd9ad7dbb8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:11.766953 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c912d9-cf81-46e8-a64d-f45132a530f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.768548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c912d9-cf81-46e8-a64d-f45132a530f6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.778773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 810/1599] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:11.778773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92ffb2-1b37-4fda-ac0b-fd9ad7dbb8fa None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.779671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 790/1600] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.780213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c912d9-cf81-46e8-a64d-f45132a530f6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.790084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c912d9-cf81-46e8-a64d-f45132a530f6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.794808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c08b2e-e85c-498c-9fec-f56bf2fae786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.795470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c08b2e-e85c-498c-9fec-f56bf2fae786 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.795586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92ffb2-1b37-4fda-ac0b-fd9ad7dbb8fa None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.795750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c08b2e-e85c-498c-9fec-f56bf2fae786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.796025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c08b2e-e85c-498c-9fec-f56bf2fae786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.796748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c08b2e-e85c-498c-9fec-f56bf2fae786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.798368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c08b2e-e85c-498c-9fec-f56bf2fae786 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.800305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c444b3-c7b5-417c-90b9-1b9055a0a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.801024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c444b3-c7b5-417c-90b9-1b9055a0a3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.801317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c444b3-c7b5-417c-90b9-1b9055a0a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.801599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c444b3-c7b5-417c-90b9-1b9055a0a3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.802389 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c444b3-c7b5-417c-90b9-1b9055a0a3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.803991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c444b3-c7b5-417c-90b9-1b9055a0a3c8 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.809052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 791/1601] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.809751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c08b2e-e85c-498c-9fec-f56bf2fae786 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.818438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 811/1602] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.818438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c444b3-c7b5-417c-90b9-1b9055a0a3c8 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.819477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c08b2e-e85c-498c-9fec-f56bf2fae786 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.824968 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb759a-2285-4d8b-8877-7b85a03f7994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.825848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb759a-2285-4d8b-8877-7b85a03f7994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.826136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb759a-2285-4d8b-8877-7b85a03f7994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.826446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb759a-2285-4d8b-8877-7b85a03f7994 admin admin] PATH_INFO: `/v3/projects/a7b91db66c6c4c878815e1aac3bb0d59/users/008d38040625431d8dbbb50a87da99ae/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.828403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb759a-2285-4d8b-8877-7b85a03f7994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b91db66c6c4c878815e1aac3bb0d59, user_id=008d38040625431d8dbbb50a87da99ae, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.828586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c444b3-c7b5-417c-90b9-1b9055a0a3c8 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.831100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfb759a-2285-4d8b-8877-7b85a03f7994 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.833865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c558a-ae69-4964-bc93-52c615d72e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.834533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c558a-ae69-4964-bc93-52c615d72e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.834830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c558a-ae69-4964-bc93-52c615d72e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.835113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c558a-ae69-4964-bc93-52c615d72e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.835852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c558a-ae69-4964-bc93-52c615d72e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.837440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c558a-ae69-4964-bc93-52c615d72e0e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.842792 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 792/1603] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:11 2022] PUT /identity/v3/projects/a7b91db66c6c4c878815e1aac3bb0d59/users/008d38040625431d8dbbb50a87da99ae/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:11.843406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb759a-2285-4d8b-8877-7b85a03f7994 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.851996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 812/1604] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:11.851996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c558a-ae69-4964-bc93-52c615d72e0e admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.860368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c558a-ae69-4964-bc93-52c615d72e0e admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.916598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb759a-2285-4d8b-8877-7b85a03f7994 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:11.919383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9797b-91ba-45cb-8e06-4c9089a0e2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.920292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9797b-91ba-45cb-8e06-4c9089a0e2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.920584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9797b-91ba-45cb-8e06-4c9089a0e2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.920870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9797b-91ba-45cb-8e06-4c9089a0e2fa admin admin] PATH_INFO: `/v3/projects/0bc3095aa3c54ff2998ae86800a3f629/users/0d38112546824c23b52e1fad9bfe17d8/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.921585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c80c7-d271-437e-942b-439ed090ee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:11.922496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c80c7-d271-437e-942b-439ed090ee51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:11.922779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c80c7-d271-437e-942b-439ed090ee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:11.923067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c80c7-d271-437e-942b-439ed090ee51 admin admin] PATH_INFO: `/v3/projects/15ad9d19847049c18d3bdc9f6e6c5168/users/79023e778baa45888e6ef870499e5ad8/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:11.936278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9797b-91ba-45cb-8e06-4c9089a0e2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc3095aa3c54ff2998ae86800a3f629, user_id=0d38112546824c23b52e1fad9bfe17d8, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.938244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c80c7-d271-437e-942b-439ed090ee51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ad9d19847049c18d3bdc9f6e6c5168, user_id=79023e778baa45888e6ef870499e5ad8, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:11.939030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9797b-91ba-45cb-8e06-4c9089a0e2fa admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.940911 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c80c7-d271-437e-942b-439ed090ee51 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:11.960911 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 813/1605] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:11 2022] PUT /identity/v3/projects/0bc3095aa3c54ff2998ae86800a3f629/users/0d38112546824c23b52e1fad9bfe17d8/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:11.961134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 793/1606] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:11 2022] PUT /identity/v3/projects/15ad9d19847049c18d3bdc9f6e6c5168/users/79023e778baa45888e6ef870499e5ad8/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:11.961248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9797b-91ba-45cb-8e06-4c9089a0e2fa admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.961370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c80c7-d271-437e-942b-439ed090ee51 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:11.962308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-709c80c7-d271-437e-942b-439ed090ee51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:11.987890 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:12.007512 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:12.026211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c80c7-d271-437e-942b-439ed090ee51 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:12.027789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9797b-91ba-45cb-8e06-4c9089a0e2fa admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:12.030803 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8acbd-41a5-4972-ad4f-85043422357f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:12.031639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8acbd-41a5-4972-ad4f-85043422357f service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.032029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8acbd-41a5-4972-ad4f-85043422357f service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.032348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8acbd-41a5-4972-ad4f-85043422357f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.091591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d1fbf-f8be-49bf-97cd-2a4761e3f745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:12.092643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d1fbf-f8be-49bf-97cd-2a4761e3f745 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.093598 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d1fbf-f8be-49bf-97cd-2a4761e3f745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.093598 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d1fbf-f8be-49bf-97cd-2a4761e3f745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.095062 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d1fbf-f8be-49bf-97cd-2a4761e3f745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:12.098120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d1fbf-f8be-49bf-97cd-2a4761e3f745 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:12.099306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8acbd-41a5-4972-ad4f-85043422357f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:12.100931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8acbd-41a5-4972-ad4f-85043422357f service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:12.112138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 794/1607] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:12.113050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8acbd-41a5-4972-ad4f-85043422357f service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:12.113443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 814/1608] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:12.114277 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d1fbf-f8be-49bf-97cd-2a4761e3f745 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:12.126372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8acbd-41a5-4972-ad4f-85043422357f service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:12.131430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed968f9-ebe1-41ac-b5e6-185423534158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:12.132335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed968f9-ebe1-41ac-b5e6-185423534158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.132517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed968f9-ebe1-41ac-b5e6-185423534158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.133027 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed968f9-ebe1-41ac-b5e6-185423534158 admin admin] PATH_INFO: `/v3/projects/76680cc3cbbf45328e05bee398de20de/users/75f62561a96f471b9dcc660e7aa9ff60/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.140213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d1fbf-f8be-49bf-97cd-2a4761e3f745 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:12.152407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23a370-b33a-4487-b6c7-dba0bb1df362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:12.152776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed968f9-ebe1-41ac-b5e6-185423534158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76680cc3cbbf45328e05bee398de20de, user_id=75f62561a96f471b9dcc660e7aa9ff60, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:12.154501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23a370-b33a-4487-b6c7-dba0bb1df362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.155046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23a370-b33a-4487-b6c7-dba0bb1df362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.155807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23a370-b33a-4487-b6c7-dba0bb1df362 admin admin] PATH_INFO: `/v3/projects/cbc5100fc9604f2680d587ca0acccd1e/users/c44559fc86c149ea92c4566ccc7d521d/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.155937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed968f9-ebe1-41ac-b5e6-185423534158 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:12.171427 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 795/1609] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:12 2022] PUT /identity/v3/projects/76680cc3cbbf45328e05bee398de20de/users/75f62561a96f471b9dcc660e7aa9ff60/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:12.172718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df900-eabc-4998-b1c4-17b54962eec4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.173009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df900-eabc-4998-b1c4-17b54962eec4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.173285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df900-eabc-4998-b1c4-17b54962eec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.190481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23a370-b33a-4487-b6c7-dba0bb1df362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc5100fc9604f2680d587ca0acccd1e, user_id=c44559fc86c149ea92c4566ccc7d521d, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:12.203274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23a370-b33a-4487-b6c7-dba0bb1df362 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:12.205904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c47df900-eabc-4998-b1c4-17b54962eec4 None None] MFA Rules not processed for user `008d38040625431d8dbbb50a87da99ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:12.207469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c47df900-eabc-4998-b1c4-17b54962eec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:12.225937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 815/1610] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:12 2022] PUT /identity/v3/projects/cbc5100fc9604f2680d587ca0acccd1e/users/c44559fc86c149ea92c4566ccc7d521d/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:12.227719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23a370-b33a-4487-b6c7-dba0bb1df362 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:12.305678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 796/1611] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:12 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:12.307324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45217f2-f354-413f-9083-273c23550832 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.307853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45217f2-f354-413f-9083-273c23550832 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.308209 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45217f2-f354-413f-9083-273c23550832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.311695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23a370-b33a-4487-b6c7-dba0bb1df362 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:12.320252 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0c671-7096-4d1f-bedc-3daf4bb317ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:12.322478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c671-7096-4d1f-bedc-3daf4bb317ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.322785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c671-7096-4d1f-bedc-3daf4bb317ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.323075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c671-7096-4d1f-bedc-3daf4bb317ce admin admin] PATH_INFO: `/v3/projects/7115292b1995402489d8d56d271179cb/users/cb84443706474e58892b2b203104e529/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.327809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f45217f2-f354-413f-9083-273c23550832 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:12.328998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f45217f2-f354-413f-9083-273c23550832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:12.341748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 797/1612] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:12.343257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1e90b-abdc-4ae0-a46c-843978c728d2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.343528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1e90b-abdc-4ae0-a46c-843978c728d2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.343804 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1e90b-abdc-4ae0-a46c-843978c728d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.346694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0c671-7096-4d1f-bedc-3daf4bb317ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7115292b1995402489d8d56d271179cb, user_id=cb84443706474e58892b2b203104e529, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:12.350862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0c671-7096-4d1f-bedc-3daf4bb317ce admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:12.369873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 816/1613] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:12 2022] PUT /identity/v3/projects/7115292b1995402489d8d56d271179cb/users/cb84443706474e58892b2b203104e529/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:12.371008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0c671-7096-4d1f-bedc-3daf4bb317ce admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:12.375894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b2b1e90b-abdc-4ae0-a46c-843978c728d2 None None] MFA Rules not processed for user `0d38112546824c23b52e1fad9bfe17d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:12.377128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b2b1e90b-abdc-4ae0-a46c-843978c728d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:12.396073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:12.451294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:12.460413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 798/1614] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:12.465391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3cf75-1653-425f-8c4f-324d23420ea0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.465781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3cf75-1653-425f-8c4f-324d23420ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.466181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3cf75-1653-425f-8c4f-324d23420ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.477644 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0c671-7096-4d1f-bedc-3daf4bb317ce admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:12.484745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d878c-90a2-40ee-9413-377f55a106f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:12.485971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d878c-90a2-40ee-9413-377f55a106f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.486354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d878c-90a2-40ee-9413-377f55a106f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.486668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d878c-90a2-40ee-9413-377f55a106f4 admin admin] PATH_INFO: `/v3/projects/04521d438cec4d90942b74c8334f6e2e/users/17166cb363d447c688088696639b9aa7/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.486894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7ae3cf75-1653-425f-8c4f-324d23420ea0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:12.488148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7ae3cf75-1653-425f-8c4f-324d23420ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:12.500088 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 799/1615] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:12.503879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e07bd9-2d73-4a98-896d-ab087e527678 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.504171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e07bd9-2d73-4a98-896d-ab087e527678 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.504464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e07bd9-2d73-4a98-896d-ab087e527678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.513471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d878c-90a2-40ee-9413-377f55a106f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04521d438cec4d90942b74c8334f6e2e, user_id=17166cb363d447c688088696639b9aa7, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:12.516582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d878c-90a2-40ee-9413-377f55a106f4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:12.541589 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-27e07bd9-2d73-4a98-896d-ab087e527678 None None] MFA Rules not processed for user `c44559fc86c149ea92c4566ccc7d521d`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:12.542866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-27e07bd9-2d73-4a98-896d-ab087e527678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:12.547507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 817/1616] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:12 2022] PUT /identity/v3/projects/04521d438cec4d90942b74c8334f6e2e/users/17166cb363d447c688088696639b9aa7/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:12.548616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d878c-90a2-40ee-9413-377f55a106f4 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:12.659593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 800/1617] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:12 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:12.661471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e07bd9-2d73-4a98-896d-ab087e527678 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:12.663344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d878c-90a2-40ee-9413-377f55a106f4 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:12.685231 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c725e90-adb6-4143-bb6d-c009dbbd1663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:12.686610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c725e90-adb6-4143-bb6d-c009dbbd1663 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.687753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c725e90-adb6-4143-bb6d-c009dbbd1663 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.689092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c725e90-adb6-4143-bb6d-c009dbbd1663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.736515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e07bd9-2d73-4a98-896d-ab087e527678 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:12.741101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cb9d0-ad89-4483-9202-55422f6a7f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:12.742004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb9d0-ad89-4483-9202-55422f6a7f42 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.742522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb9d0-ad89-4483-9202-55422f6a7f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.743048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb9d0-ad89-4483-9202-55422f6a7f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.779714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c725e90-adb6-4143-bb6d-c009dbbd1663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:12.781514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c725e90-adb6-4143-bb6d-c009dbbd1663 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:12.802901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 818/1618] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:12 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:12.804423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd40cc5-bf69-4081-914d-5d322ce42f23 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.804716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd40cc5-bf69-4081-914d-5d322ce42f23 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.804997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd40cc5-bf69-4081-914d-5d322ce42f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.816323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:12.834106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cb9d0-ad89-4483-9202-55422f6a7f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:12.836634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336cb9d0-ad89-4483-9202-55422f6a7f42 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:12.848693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-7fd40cc5-bf69-4081-914d-5d322ce42f23 None None] MFA Rules not processed for user `cb84443706474e58892b2b203104e529`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:12.849988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7fd40cc5-bf69-4081-914d-5d322ce42f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:12.852078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 801/1619] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:12.854020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cb9d0-ad89-4483-9202-55422f6a7f42 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:12.868588 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cb9d0-ad89-4483-9202-55422f6a7f42 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:12.875668 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e19b66-cb79-42f9-92c8-734936d218ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:12.877206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19b66-cb79-42f9-92c8-734936d218ec admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.877603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19b66-cb79-42f9-92c8-734936d218ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.877982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19b66-cb79-42f9-92c8-734936d218ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:12.878960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e19b66-cb79-42f9-92c8-734936d218ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:12.881155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e19b66-cb79-42f9-92c8-734936d218ec admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:12.938867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 802/1620] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:12 2022] POST /identity/v3/projects => generated 405 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:12.939977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e19b66-cb79-42f9-92c8-734936d218ec admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:12.959429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 819/1621] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:12.966774 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf079c-cfbf-456f-b0e6-00a00a50628f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:12.967213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf079c-cfbf-456f-b0e6-00a00a50628f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:12.968107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf079c-cfbf-456f-b0e6-00a00a50628f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:13.002491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:13.024627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e19b66-cb79-42f9-92c8-734936d218ec admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:13.029043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fa7ac-0fe7-4407-9a70-51bbccb4c564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:13.030277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fa7ac-0fe7-4407-9a70-51bbccb4c564 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:13.030576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fa7ac-0fe7-4407-9a70-51bbccb4c564 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:13.030850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6fa7ac-0fe7-4407-9a70-51bbccb4c564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:13.033585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c2bf079c-cfbf-456f-b0e6-00a00a50628f None None] MFA Rules not processed for user `17166cb363d447c688088696639b9aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:13.035281 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c2bf079c-cfbf-456f-b0e6-00a00a50628f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:13.142398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fa7ac-0fe7-4407-9a70-51bbccb4c564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:13.143983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6fa7ac-0fe7-4407-9a70-51bbccb4c564 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:13.171889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 803/1622] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:13.172963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fa7ac-0fe7-4407-9a70-51bbccb4c564 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:13.222575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 820/1623] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:13.223484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf079c-cfbf-456f-b0e6-00a00a50628f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:13.324052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6fa7ac-0fe7-4407-9a70-51bbccb4c564 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:13.331524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9091ae-656e-4601-87cf-8514605547e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:13.332255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9091ae-656e-4601-87cf-8514605547e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:13.332476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9091ae-656e-4601-87cf-8514605547e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:13.332755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9091ae-656e-4601-87cf-8514605547e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:13.352790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf079c-cfbf-456f-b0e6-00a00a50628f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:13.362405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57928770-3cb5-4a16-b745-129dd9f02aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:13.363108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928770-3cb5-4a16-b745-129dd9f02aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:13.363401 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928770-3cb5-4a16-b745-129dd9f02aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:13.363685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57928770-3cb5-4a16-b745-129dd9f02aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:13.411703 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:13.486732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9091ae-656e-4601-87cf-8514605547e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:13.489368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9091ae-656e-4601-87cf-8514605547e5 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:13.506360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 804/1624] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:13.507199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9091ae-656e-4601-87cf-8514605547e5 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:13.519454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9091ae-656e-4601-87cf-8514605547e5 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:13.519859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57928770-3cb5-4a16-b745-129dd9f02aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:13.523507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57928770-3cb5-4a16-b745-129dd9f02aa2 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:13.526093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9430ed9-9664-41d0-acc4-43445eebcced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:13.526810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9430ed9-9664-41d0-acc4-43445eebcced admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:13.527092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9430ed9-9664-41d0-acc4-43445eebcced admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:13.528084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9430ed9-9664-41d0-acc4-43445eebcced admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:13.528812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9430ed9-9664-41d0-acc4-43445eebcced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:13.530801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9430ed9-9664-41d0-acc4-43445eebcced admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:13.549188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 821/1625] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:13 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:13.553003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096909c-6de2-445c-99d5-7ca22f2c2ed9 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:13.553311 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096909c-6de2-445c-99d5-7ca22f2c2ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:13.553603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096909c-6de2-445c-99d5-7ca22f2c2ed9 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:13.558950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 822/1626] 10.222.0.66 () {54 vars in 961 bytes} [Mon Jul 11 14:13:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:13.559972 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096909c-6de2-445c-99d5-7ca22f2c2ed9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:13.576475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 805/1627] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:13 2022] POST /identity/v3/users => generated 309 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:13.579602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71588b49-f66c-4864-8a02-79a7043788c2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:13.579896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71588b49-f66c-4864-8a02-79a7043788c2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:13.583279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71588b49-f66c-4864-8a02-79a7043788c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:13.616946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096909c-6de2-445c-99d5-7ca22f2c2ed9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:13.645851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337abc6-7924-4bb3-9fc1-6fe879c4ade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:13.646582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337abc6-7924-4bb3-9fc1-6fe879c4ade3 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:13.646911 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337abc6-7924-4bb3-9fc1-6fe879c4ade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:13.647800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337abc6-7924-4bb3-9fc1-6fe879c4ade3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:13.656179 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337abc6-7924-4bb3-9fc1-6fe879c4ade3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:13.664761 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337abc6-7924-4bb3-9fc1-6fe879c4ade3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:13.681510 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-71588b49-f66c-4864-8a02-79a7043788c2 None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:13.682869 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-71588b49-f66c-4864-8a02-79a7043788c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:13.789298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 823/1628] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:13 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:13.792318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337abc6-7924-4bb3-9fc1-6fe879c4ade3 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:13.867382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:13.935365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337abc6-7924-4bb3-9fc1-6fe879c4ade3 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:13.947787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e0eb5-a2aa-43bb-9588-9af4e0db8cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:13.948539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e0eb5-a2aa-43bb-9588-9af4e0db8cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:13.948825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e0eb5-a2aa-43bb-9588-9af4e0db8cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:13.949102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3e0eb5-a2aa-43bb-9588-9af4e0db8cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:13.949990 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e0eb5-a2aa-43bb-9588-9af4e0db8cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:13.953359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3e0eb5-a2aa-43bb-9588-9af4e0db8cf2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:13.983203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 824/1629] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:13.983203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e0eb5-a2aa-43bb-9588-9af4e0db8cf2 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:13.988959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 806/1630] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Jul 11 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:13.991193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71588b49-f66c-4864-8a02-79a7043788c2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:14.005487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3e0eb5-a2aa-43bb-9588-9af4e0db8cf2 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:14.007860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71588b49-f66c-4864-8a02-79a7043788c2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:14.019336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e526b-84c5-49ac-9dff-5b42cf0f95d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:14.020551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b11315-036a-41ad-ad09-a09c0acbdf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:14.020795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e526b-84c5-49ac-9dff-5b42cf0f95d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:14.021244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b11315-036a-41ad-ad09-a09c0acbdf56 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:14.021425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e526b-84c5-49ac-9dff-5b42cf0f95d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:14.021536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b11315-036a-41ad-ad09-a09c0acbdf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:14.021797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b11315-036a-41ad-ad09-a09c0acbdf56 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:14.021980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e526b-84c5-49ac-9dff-5b42cf0f95d9 admin admin] PATH_INFO: `/v3/projects/67dae37d210b4310ae2a19054a35fd49/users/f85f1b9f815a44f0bf27dad8ff96c381/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:14.022535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b11315-036a-41ad-ad09-a09c0acbdf56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:14.034546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b11315-036a-41ad-ad09-a09c0acbdf56 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:14.055317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e526b-84c5-49ac-9dff-5b42cf0f95d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67dae37d210b4310ae2a19054a35fd49, user_id=f85f1b9f815a44f0bf27dad8ff96c381, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:14.066418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e526b-84c5-49ac-9dff-5b42cf0f95d9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:14.070585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 825/1631] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:13 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:14.071578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b11315-036a-41ad-ad09-a09c0acbdf56 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:14.100434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 807/1632] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:13 2022] PUT /identity/v3/projects/67dae37d210b4310ae2a19054a35fd49/users/f85f1b9f815a44f0bf27dad8ff96c381/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:14.100434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e526b-84c5-49ac-9dff-5b42cf0f95d9 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:14.224433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e526b-84c5-49ac-9dff-5b42cf0f95d9 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:14.260892 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c146a-fd67-49aa-b630-a460f27be8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:14.261774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c146a-fd67-49aa-b630-a460f27be8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:14.262243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c146a-fd67-49aa-b630-a460f27be8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:14.262598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c146a-fd67-49aa-b630-a460f27be8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:14.263518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c146a-fd67-49aa-b630-a460f27be8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:14.265522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c146a-fd67-49aa-b630-a460f27be8e5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:14.288578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b11315-036a-41ad-ad09-a09c0acbdf56 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:14.305415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 808/1633] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:14.313331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c146a-fd67-49aa-b630-a460f27be8e5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:14.333157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:14.347396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c146a-fd67-49aa-b630-a460f27be8e5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:14.363473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796de00-f3cd-4064-9217-37afc429a97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:14.365564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796de00-f3cd-4064-9217-37afc429a97c admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:14.365564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796de00-f3cd-4064-9217-37afc429a97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:14.365866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796de00-f3cd-4064-9217-37afc429a97c admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:14.366649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796de00-f3cd-4064-9217-37afc429a97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:14.374864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796de00-f3cd-4064-9217-37afc429a97c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:14.403404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 809/1634] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:14.403404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796de00-f3cd-4064-9217-37afc429a97c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:14.426927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796de00-f3cd-4064-9217-37afc429a97c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:14.438023 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d1592-7a11-4bbb-a1de-66db5ba5cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:14.440230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d1592-7a11-4bbb-a1de-66db5ba5cc4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:14.443924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d1592-7a11-4bbb-a1de-66db5ba5cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:14.444222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d1592-7a11-4bbb-a1de-66db5ba5cc4b admin admin] PATH_INFO: `/v3/projects/2ea31890c170427f9c3c5c3f2c442e21/users/b2f762a4dd434ce2916451d13d1f07bc/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:14.481519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d1592-7a11-4bbb-a1de-66db5ba5cc4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea31890c170427f9c3c5c3f2c442e21, user_id=b2f762a4dd434ce2916451d13d1f07bc, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:14.482413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8e137-4b94-46e6-a5a9-ff93d931bb27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:14.486939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8e137-4b94-46e6-a5a9-ff93d931bb27 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:14.487127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d1592-7a11-4bbb-a1de-66db5ba5cc4b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:14.487922 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8e137-4b94-46e6-a5a9-ff93d931bb27 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:14.491176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8e137-4b94-46e6-a5a9-ff93d931bb27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:14.519708 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 810/1635] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:14 2022] PUT /identity/v3/projects/2ea31890c170427f9c3c5c3f2c442e21/users/b2f762a4dd434ce2916451d13d1f07bc/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:14.521769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d1592-7a11-4bbb-a1de-66db5ba5cc4b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:14.624186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:14.663653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8e137-4b94-46e6-a5a9-ff93d931bb27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:14.665283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8e137-4b94-46e6-a5a9-ff93d931bb27 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:14.680551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d1592-7a11-4bbb-a1de-66db5ba5cc4b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:14.704733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5e7dd-b328-4334-9c6c-314db9ef39a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:14.705678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 826/1636] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:14.705678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8e137-4b94-46e6-a5a9-ff93d931bb27 service nova] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:14.712158 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e7dd-b328-4334-9c6c-314db9ef39a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:14.712498 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e7dd-b328-4334-9c6c-314db9ef39a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:14.712786 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e7dd-b328-4334-9c6c-314db9ef39a9 admin admin] PATH_INFO: `/v3/projects/67dae37d210b4310ae2a19054a35fd49/users/f85f1b9f815a44f0bf27dad8ff96c381/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:14.715190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8e137-4b94-46e6-a5a9-ff93d931bb27 service nova] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:14.721092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb1219-70c6-4e76-b9bd-41144c88190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:14.722300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb1219-70c6-4e76-b9bd-41144c88190f admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:14.723039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb1219-70c6-4e76-b9bd-41144c88190f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:14.723643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb1219-70c6-4e76-b9bd-41144c88190f admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:14.723917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb1219-70c6-4e76-b9bd-41144c88190f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:14.724402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5e7dd-b328-4334-9c6c-314db9ef39a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67dae37d210b4310ae2a19054a35fd49, user_id=f85f1b9f815a44f0bf27dad8ff96c381, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:14.725851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb1219-70c6-4e76-b9bd-41144c88190f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:14.731164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5e7dd-b328-4334-9c6c-314db9ef39a9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:14.745318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 827/1637] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:14.749611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb1219-70c6-4e76-b9bd-41144c88190f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:14.762185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb1219-70c6-4e76-b9bd-41144c88190f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:14.790450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 811/1638] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:14 2022] PUT /identity/v3/projects/67dae37d210b4310ae2a19054a35fd49/users/f85f1b9f815a44f0bf27dad8ff96c381/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:14.796963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3c16-3343-4b4e-8e67-88344d3ed4a4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:14.797257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3c16-3343-4b4e-8e67-88344d3ed4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:14.797553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3c16-3343-4b4e-8e67-88344d3ed4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:14.833600 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f018e6-c135-4aeb-826f-86dbd82a611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:14.834706 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f018e6-c135-4aeb-826f-86dbd82a611a admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:14.835092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f018e6-c135-4aeb-826f-86dbd82a611a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:14.835469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f018e6-c135-4aeb-826f-86dbd82a611a admin admin] PATH_INFO: `/v3/projects/2ea31890c170427f9c3c5c3f2c442e21/users/b2f762a4dd434ce2916451d13d1f07bc/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:14.840425 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f018e6-c135-4aeb-826f-86dbd82a611a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea31890c170427f9c3c5c3f2c442e21, user_id=b2f762a4dd434ce2916451d13d1f07bc, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:14.843764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f018e6-c135-4aeb-826f-86dbd82a611a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:14.861389 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 828/1639] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:14 2022] PUT /identity/v3/projects/2ea31890c170427f9c3c5c3f2c442e21/users/b2f762a4dd434ce2916451d13d1f07bc/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:13:14.872061 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214238d9-905c-4797-bf6e-53acd400bffb None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:14.872756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214238d9-905c-4797-bf6e-53acd400bffb None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:14.873259 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214238d9-905c-4797-bf6e-53acd400bffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:14.897575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d5df3c16-3343-4b4e-8e67-88344d3ed4a4 None None] MFA Rules not processed for user `f85f1b9f815a44f0bf27dad8ff96c381`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:14.898874 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d5df3c16-3343-4b4e-8e67-88344d3ed4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:14.933833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-214238d9-905c-4797-bf6e-53acd400bffb None None] MFA Rules not processed for user `b2f762a4dd434ce2916451d13d1f07bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:14.936631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-214238d9-905c-4797-bf6e-53acd400bffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:15.104950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 829/1640] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:15.104950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214238d9-905c-4797-bf6e-53acd400bffb None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:15.105910 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 812/1641] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:15.117252 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df3c16-3343-4b4e-8e67-88344d3ed4a4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:15.215626 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214238d9-905c-4797-bf6e-53acd400bffb None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:15.222220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3c7e9-a43c-416e-ac78-ba63647671cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:15.222968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3c7e9-a43c-416e-ac78-ba63647671cc service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:15.223261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3c7e9-a43c-416e-ac78-ba63647671cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:15.223960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3c7e9-a43c-416e-ac78-ba63647671cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:15.232523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:15.237195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3c7e9-a43c-416e-ac78-ba63647671cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:15.238749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3c7e9-a43c-416e-ac78-ba63647671cc service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:15.255508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:15.256532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 830/1642] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:15.260739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c6c5-9352-4bd6-84ae-a5d64554bc96 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:15.261149 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df3c16-3343-4b4e-8e67-88344d3ed4a4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:15.261588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c6c5-9352-4bd6-84ae-a5d64554bc96 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:15.262327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15c6c5-9352-4bd6-84ae-a5d64554bc96 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:15.264999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 831/1643] 10.222.0.66 () {54 vars in 912 bytes} [Mon Jul 11 14:13:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:15.270409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3540f6-0d38-4ed6-b6bd-97c7c1510384 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:15.270686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93e67f-6218-4f4c-8680-83f5c9874e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:15.270814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3540f6-0d38-4ed6-b6bd-97c7c1510384 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:15.271034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3540f6-0d38-4ed6-b6bd-97c7c1510384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:15.271322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e67f-6218-4f4c-8680-83f5c9874e99 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:15.271609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e67f-6218-4f4c-8680-83f5c9874e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:15.271889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93e67f-6218-4f4c-8680-83f5c9874e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:15.282972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93e67f-6218-4f4c-8680-83f5c9874e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:15.284361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93e67f-6218-4f4c-8680-83f5c9874e99 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:15.297557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5a3540f6-0d38-4ed6-b6bd-97c7c1510384 None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:15.298638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 813/1644] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:15 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:15.312571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5a3540f6-0d38-4ed6-b6bd-97c7c1510384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:15.418499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 832/1645] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:13:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:15.496074 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93e67f-6218-4f4c-8680-83f5c9874e99 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:15.512773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93e67f-6218-4f4c-8680-83f5c9874e99 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:15.523151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be10ca7-3436-41ba-8643-26e0f49a5a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:15.524730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be10ca7-3436-41ba-8643-26e0f49a5a04 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:15.526251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be10ca7-3436-41ba-8643-26e0f49a5a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:15.526937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be10ca7-3436-41ba-8643-26e0f49a5a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:15.543227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be10ca7-3436-41ba-8643-26e0f49a5a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:15.544875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be10ca7-3436-41ba-8643-26e0f49a5a04 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:15.562416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 814/1646] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:15.581899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3540f6-0d38-4ed6-b6bd-97c7c1510384 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:15.593937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3540f6-0d38-4ed6-b6bd-97c7c1510384 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:15.599246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09892d-5f9f-49ed-af95-689483e436f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:15.600359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09892d-5f9f-49ed-af95-689483e436f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:15.600955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09892d-5f9f-49ed-af95-689483e436f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:15.601417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09892d-5f9f-49ed-af95-689483e436f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:15.689303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09892d-5f9f-49ed-af95-689483e436f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:15.691897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09892d-5f9f-49ed-af95-689483e436f2 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:15.706199 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 833/1647] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:16.036798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be10ca7-3436-41ba-8643-26e0f49a5a04 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:16.253859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be10ca7-3436-41ba-8643-26e0f49a5a04 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:16.283362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcedd49e-8b60-46ef-a22b-7b35be59464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:16.288955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedd49e-8b60-46ef-a22b-7b35be59464f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:16.292483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedd49e-8b60-46ef-a22b-7b35be59464f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:16.293855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcedd49e-8b60-46ef-a22b-7b35be59464f admin admin] PATH_INFO: `/v3/users/0d38112546824c23b52e1fad9bfe17d8` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:16.302347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedd49e-8b60-46ef-a22b-7b35be59464f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d38112546824c23b52e1fad9bfe17d8)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:16.308753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcedd49e-8b60-46ef-a22b-7b35be59464f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:16.450016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fcedd49e-8b60-46ef-a22b-7b35be59464f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d38112546824c23b52e1fad9bfe17d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:16.452770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fcedd49e-8b60-46ef-a22b-7b35be59464f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d38112546824c23b52e1fad9bfe17d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:16.453698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fcedd49e-8b60-46ef-a22b-7b35be59464f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d38112546824c23b52e1fad9bfe17d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:16.465433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fcedd49e-8b60-46ef-a22b-7b35be59464f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d38112546824c23b52e1fad9bfe17d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:16.494988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fcedd49e-8b60-46ef-a22b-7b35be59464f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d38112546824c23b52e1fad9bfe17d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:16.535003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 815/1648] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:16 2022] DELETE /identity/v3/users/0d38112546824c23b52e1fad9bfe17d8 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:16.539996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb76f9-5d05-4b66-bd30-8983ef0e59b1 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:16.540300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb76f9-5d05-4b66-bd30-8983ef0e59b1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:16.540667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb76f9-5d05-4b66-bd30-8983ef0e59b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:16.582093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5ebb76f9-5d05-4b66-bd30-8983ef0e59b1 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:16.583359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5ebb76f9-5d05-4b66-bd30-8983ef0e59b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:16.610019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0a0d9-4692-4cdf-99d8-6a5ed438f926 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:16.612297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0a0d9-4692-4cdf-99d8-6a5ed438f926 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:16.613099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0a0d9-4692-4cdf-99d8-6a5ed438f926 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:16.615255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 816/1649] 10.222.0.66 () {54 vars in 961 bytes} [Mon Jul 11 14:13:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:16.627094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72850528-e907-4264-8ef2-d03087a4cfe9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:16.627670 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72850528-e907-4264-8ef2-d03087a4cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:16.628417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72850528-e907-4264-8ef2-d03087a4cfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:16.674297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-72850528-e907-4264-8ef2-d03087a4cfe9 None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:16.676603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-72850528-e907-4264-8ef2-d03087a4cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:16.725806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 834/1650] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:16.754626 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb76f9-5d05-4b66-bd30-8983ef0e59b1 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:16.756164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5ebb76f9-5d05-4b66-bd30-8983ef0e59b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:16.824587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:16.851212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:16.894071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 817/1651] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Jul 11 14:13:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:13:16.896841 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db582a3-357a-4ffb-8977-d73af7b0207a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:16.897858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb76f9-5d05-4b66-bd30-8983ef0e59b1 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:16.898122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db582a3-357a-4ffb-8977-d73af7b0207a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:16.898599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db582a3-357a-4ffb-8977-d73af7b0207a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:16.906834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3db32-728f-4740-99e1-69b62216b8f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:16.907355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3db32-728f-4740-99e1-69b62216b8f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:16.907606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3db32-728f-4740-99e1-69b62216b8f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:16.907882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3db32-728f-4740-99e1-69b62216b8f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:16.908267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 818/1652] 10.222.0.66 () {54 vars in 912 bytes} [Mon Jul 11 14:13:16 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:16.911225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2713f9b-8d90-4e07-84e6-15e008d233d6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:16.911925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2713f9b-8d90-4e07-84e6-15e008d233d6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:16.912800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2713f9b-8d90-4e07-84e6-15e008d233d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:16.928768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3db32-728f-4740-99e1-69b62216b8f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:16.932013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3db32-728f-4740-99e1-69b62216b8f9 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:16.957239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 835/1653] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:16.971586 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b2713f9b-8d90-4e07-84e6-15e008d233d6 None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:16.975364 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b2713f9b-8d90-4e07-84e6-15e008d233d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:17.018935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 819/1654] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:13:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:17.034570 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3db32-728f-4740-99e1-69b62216b8f9 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:17.036216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8bb3db32-728f-4740-99e1-69b62216b8f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:17.246556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3db32-728f-4740-99e1-69b62216b8f9 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:17.258928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccd431-622a-42dd-98d7-0d45f9291bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:17.260183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccd431-622a-42dd-98d7-0d45f9291bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:17.260485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccd431-622a-42dd-98d7-0d45f9291bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:17.261145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccd431-622a-42dd-98d7-0d45f9291bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:17.290623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccd431-622a-42dd-98d7-0d45f9291bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:17.292286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ccd431-622a-42dd-98d7-0d45f9291bb4 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:17.317952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 836/1655] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:18.608040 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2713f9b-8d90-4e07-84e6-15e008d233d6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:18.609516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b2713f9b-8d90-4e07-84e6-15e008d233d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:18.644560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2713f9b-8d90-4e07-84e6-15e008d233d6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:18.664755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:18.665716 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:18.666548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:18.666835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] PATH_INFO: `/v3/projects/0bc3095aa3c54ff2998ae86800a3f629` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:18.668971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc3095aa3c54ff2998ae86800a3f629)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:18.670291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:13:18.670291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: warnings.warn(msg) Jul 11 14:13:18.670291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: Jul 11 14:13:18.674624 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:18.823854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc3095aa3c54ff2998ae86800a3f629', 'request_id': 'req-85849cb0-9c5d-446d-bf88-e81bb35423ed'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:18.855838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc3095aa3c54ff2998ae86800a3f629', 'request_id': 'req-85849cb0-9c5d-446d-bf88-e81bb35423ed'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:18.885779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc3095aa3c54ff2998ae86800a3f629', 'request_id': 'req-85849cb0-9c5d-446d-bf88-e81bb35423ed'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:18.933499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] The token cache is being invalidate because project 0bc3095aa3c54ff2998ae86800a3f629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:18.933798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:18.934566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:18.942908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 820/1656] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:18 2022] DELETE /identity/v3/projects/0bc3095aa3c54ff2998ae86800a3f629 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:18.943409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccd431-622a-42dd-98d7-0d45f9291bb4 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:18.964032 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccd431-622a-42dd-98d7-0d45f9291bb4 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:19.086293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:19.087248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:19.088185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:19.088654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] PATH_INFO: `/v3/users/f85f1b9f815a44f0bf27dad8ff96c381` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:19.095070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85f1b9f815a44f0bf27dad8ff96c381)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:19.096132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: WARNING py.warnings [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 11 14:13:19.096132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: warnings.warn(msg) Jul 11 14:13:19.096132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: Jul 11 14:13:19.097349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:19.221133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85f1b9f815a44f0bf27dad8ff96c381'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:19.221845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85f1b9f815a44f0bf27dad8ff96c381'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:19.222497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85f1b9f815a44f0bf27dad8ff96c381'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:19.234134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85f1b9f815a44f0bf27dad8ff96c381'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:19.246480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b9d54ae2-c17c-4b4a-a16e-835d6eff698b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85f1b9f815a44f0bf27dad8ff96c381'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:19.284070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:19.322982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 837/1657] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:18 2022] DELETE /identity/v3/users/f85f1b9f815a44f0bf27dad8ff96c381 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:20.152257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:20.153975 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:20.175931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85849cb0-9c5d-446d-bf88-e81bb35423ed admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:20.372734 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:20.373947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:20.374552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:20.375008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] PATH_INFO: `/v3/users/cb84443706474e58892b2b203104e529` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:20.377808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb84443706474e58892b2b203104e529)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:20.380320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:20.551156 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb84443706474e58892b2b203104e529'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:20.553833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb84443706474e58892b2b203104e529'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:20.555955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb84443706474e58892b2b203104e529'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:20.582319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb84443706474e58892b2b203104e529'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:20.606018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:20.615616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb84443706474e58892b2b203104e529'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:20.640756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 821/1658] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:20 2022] DELETE /identity/v3/users/cb84443706474e58892b2b203104e529 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:20.645247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d9d37-8c56-4ad7-9688-88a7864530c9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:20.645749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d9d37-8c56-4ad7-9688-88a7864530c9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:20.646056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d9d37-8c56-4ad7-9688-88a7864530c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:20.684723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-dc7d9d37-8c56-4ad7-9688-88a7864530c9 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:20.686561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-dc7d9d37-8c56-4ad7-9688-88a7864530c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:20.859363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 838/1659] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:20.909083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:20.911087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:20.944418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d9d37-8c56-4ad7-9688-88a7864530c9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:20.946381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-dc7d9d37-8c56-4ad7-9688-88a7864530c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:20.982072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d9d37-8c56-4ad7-9688-88a7864530c9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:20.994506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:20.995457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:20.998276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:20.998583 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] PATH_INFO: `/v3/projects/67dae37d210b4310ae2a19054a35fd49` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:21.005233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67dae37d210b4310ae2a19054a35fd49)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:21.010254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:21.018991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3960788-c71b-49dc-9492-128e1bce8eb5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:21.024026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c42068-7836-41db-b6b9-2c7269925322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:21.030226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42068-7836-41db-b6b9-2c7269925322 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:21.031218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42068-7836-41db-b6b9-2c7269925322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:21.031218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c42068-7836-41db-b6b9-2c7269925322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:21.053167 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c42068-7836-41db-b6b9-2c7269925322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:21.054796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c42068-7836-41db-b6b9-2c7269925322 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:21.082823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 822/1660] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:21.146033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67dae37d210b4310ae2a19054a35fd49', 'request_id': 'req-b3eb5316-5f7a-49e3-bb79-ec66138af45e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:21.182529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67dae37d210b4310ae2a19054a35fd49', 'request_id': 'req-b3eb5316-5f7a-49e3-bb79-ec66138af45e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:21.202143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67dae37d210b4310ae2a19054a35fd49', 'request_id': 'req-b3eb5316-5f7a-49e3-bb79-ec66138af45e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:21.233394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] The token cache is being invalidate because project 67dae37d210b4310ae2a19054a35fd49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:21.233851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:21.234813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b3eb5316-5f7a-49e3-bb79-ec66138af45e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:21.236934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 839/1661] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:20 2022] DELETE /identity/v3/projects/67dae37d210b4310ae2a19054a35fd49 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:21.241925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4faa0-7a02-490a-9e4d-33a88d9bd1bc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:21.242463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4faa0-7a02-490a-9e4d-33a88d9bd1bc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:21.242710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4faa0-7a02-490a-9e4d-33a88d9bd1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:21.303862 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-58f4faa0-7a02-490a-9e4d-33a88d9bd1bc None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:21.305128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-58f4faa0-7a02-490a-9e4d-33a88d9bd1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:21.589382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 823/1662] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:21.590789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f551c5-8edb-4d15-ae2f-d833c1be1b22 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:21.591083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f551c5-8edb-4d15-ae2f-d833c1be1b22 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:21.591370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f551c5-8edb-4d15-ae2f-d833c1be1b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:21.644333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-89f551c5-8edb-4d15-ae2f-d833c1be1b22 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:21.645662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-89f551c5-8edb-4d15-ae2f-d833c1be1b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:21.669590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 840/1663] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:21.674292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4faa0-7a02-490a-9e4d-33a88d9bd1bc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:21.689861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4faa0-7a02-490a-9e4d-33a88d9bd1bc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:21.700779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d75a2-1ebe-41d6-bf20-423977e6883d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:21.706646 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d75a2-1ebe-41d6-bf20-423977e6883d admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:21.706875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d75a2-1ebe-41d6-bf20-423977e6883d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:21.708865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d75a2-1ebe-41d6-bf20-423977e6883d admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:21.711857 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d75a2-1ebe-41d6-bf20-423977e6883d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:21.712964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d75a2-1ebe-41d6-bf20-423977e6883d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:21.716908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d75a2-1ebe-41d6-bf20-423977e6883d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:21.779185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f551c5-8edb-4d15-ae2f-d833c1be1b22 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:21.790534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 824/1664] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:21.793189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f551c5-8edb-4d15-ae2f-d833c1be1b22 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:21.805120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3bdac-de74-44c5-abef-c59ec6faf548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:21.807514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3bdac-de74-44c5-abef-c59ec6faf548 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:21.807821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3bdac-de74-44c5-abef-c59ec6faf548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:21.808109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3bdac-de74-44c5-abef-c59ec6faf548 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:21.811731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3bdac-de74-44c5-abef-c59ec6faf548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:21.817588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3bdac-de74-44c5-abef-c59ec6faf548 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:21.899196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 841/1665] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:21 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:13:21.905773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d75a2-1ebe-41d6-bf20-423977e6883d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:21.925125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d75a2-1ebe-41d6-bf20-423977e6883d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:22.030002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76989299-eeed-4ab8-bdd9-fb40fab857ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:22.031131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989299-eeed-4ab8-bdd9-fb40fab857ff admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.031585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989299-eeed-4ab8-bdd9-fb40fab857ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.032011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989299-eeed-4ab8-bdd9-fb40fab857ff admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.032872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76989299-eeed-4ab8-bdd9-fb40fab857ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:22.035028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76989299-eeed-4ab8-bdd9-fb40fab857ff admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:22.074797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 825/1666] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:21 2022] POST /identity/v3/users => generated 302 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:22.078783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3bdac-de74-44c5-abef-c59ec6faf548 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:22.081220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbb106-d757-4082-9157-0a2ebbe25164 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.081522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbb106-d757-4082-9157-0a2ebbe25164 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.081812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbb106-d757-4082-9157-0a2ebbe25164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.090409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:22.096540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3bdac-de74-44c5-abef-c59ec6faf548 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:22.107984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209a71-3213-42f4-9c7e-1ddeec7fdeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:22.108671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209a71-3213-42f4-9c7e-1ddeec7fdeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.110414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209a71-3213-42f4-9c7e-1ddeec7fdeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.112522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df209a71-3213-42f4-9c7e-1ddeec7fdeb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.113363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df209a71-3213-42f4-9c7e-1ddeec7fdeb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:22.117944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df209a71-3213-42f4-9c7e-1ddeec7fdeb7 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:22.128376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-48dbb106-d757-4082-9157-0a2ebbe25164 None None] MFA Rules not processed for user `39a5cea0a591453581a9d98ff796d973`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:22.129759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-48dbb106-d757-4082-9157-0a2ebbe25164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:22.153350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 842/1667] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:22.154533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209a71-3213-42f4-9c7e-1ddeec7fdeb7 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:22.175460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df209a71-3213-42f4-9c7e-1ddeec7fdeb7 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:22.190894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bc386-73f8-470f-8214-4b5855f559ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:22.191592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bc386-73f8-470f-8214-4b5855f559ff admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.191883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bc386-73f8-470f-8214-4b5855f559ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.192274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bc386-73f8-470f-8214-4b5855f559ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.193023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bc386-73f8-470f-8214-4b5855f559ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:22.195148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bc386-73f8-470f-8214-4b5855f559ff admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:22.230783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 843/1668] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:22.232264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bc386-73f8-470f-8214-4b5855f559ff admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:22.257359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bc386-73f8-470f-8214-4b5855f559ff admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:22.267946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c808b-4813-4864-b030-afa8dd32f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:22.269049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c808b-4813-4864-b030-afa8dd32f4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.269217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 826/1669] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:22.269633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c808b-4813-4864-b030-afa8dd32f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.269633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c808b-4813-4864-b030-afa8dd32f4e4 admin admin] PATH_INFO: `/v3/projects/043226a7fcbf40d293cce057172a94fb/users/27e8e06f381c424e915c1c0f6b0e5b97/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.270947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbb106-d757-4082-9157-0a2ebbe25164 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:22.282056 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-48dbb106-d757-4082-9157-0a2ebbe25164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:22.300497 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbb106-d757-4082-9157-0a2ebbe25164 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:22.308979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:22.310173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.310582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c808b-4813-4864-b030-afa8dd32f4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043226a7fcbf40d293cce057172a94fb, user_id=27e8e06f381c424e915c1c0f6b0e5b97, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:22.310756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.311347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] PATH_INFO: `/v3/projects/7115292b1995402489d8d56d271179cb` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.312928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7115292b1995402489d8d56d271179cb)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:22.315044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:22.321091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c808b-4813-4864-b030-afa8dd32f4e4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:22.347240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:22.357266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 844/1670] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:22 2022] PUT /identity/v3/projects/043226a7fcbf40d293cce057172a94fb/users/27e8e06f381c424e915c1c0f6b0e5b97/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:22.362360 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7610b48-3d96-45ce-b525-fc745c7568d5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.362730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7610b48-3d96-45ce-b525-fc745c7568d5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.363299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7610b48-3d96-45ce-b525-fc745c7568d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.387044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d7610b48-3d96-45ce-b525-fc745c7568d5 None None] MFA Rules not processed for user `39a5cea0a591453581a9d98ff796d973`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:22.388317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d7610b48-3d96-45ce-b525-fc745c7568d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:22.400997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7115292b1995402489d8d56d271179cb', 'request_id': 'req-02fcc118-c69b-4f61-9130-bd4c272ea41e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:22.407777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7115292b1995402489d8d56d271179cb', 'request_id': 'req-02fcc118-c69b-4f61-9130-bd4c272ea41e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:22.426594 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7115292b1995402489d8d56d271179cb', 'request_id': 'req-02fcc118-c69b-4f61-9130-bd4c272ea41e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:22.452066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] The token cache is being invalidate because project 7115292b1995402489d8d56d271179cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:22.452367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:22.453512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-02fcc118-c69b-4f61-9130-bd4c272ea41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:22.459812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 827/1671] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:22 2022] DELETE /identity/v3/projects/7115292b1995402489d8d56d271179cb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:22.459812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3779f-d34c-4fd7-9169-4f1a8843708c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.459812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3779f-d34c-4fd7-9169-4f1a8843708c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.459812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3779f-d34c-4fd7-9169-4f1a8843708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.490724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 845/1672] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:22.492593 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb8efb-c11b-473a-93b4-666cb9c5ddaf None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.493065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb8efb-c11b-473a-93b4-666cb9c5ddaf None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.493554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-20a3779f-d34c-4fd7-9169-4f1a8843708c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:22.493977 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb8efb-c11b-473a-93b4-666cb9c5ddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.495708 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-20a3779f-d34c-4fd7-9169-4f1a8843708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:22.520448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-7bfb8efb-c11b-473a-93b4-666cb9c5ddaf None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:22.522271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7bfb8efb-c11b-473a-93b4-666cb9c5ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:22.633495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 828/1673] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:22.636623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3779f-d34c-4fd7-9169-4f1a8843708c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:22.638075 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-20a3779f-d34c-4fd7-9169-4f1a8843708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:22.675793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:22.687887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 846/1674] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:22.688800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb8efb-c11b-473a-93b4-666cb9c5ddaf None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:22.690190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7bfb8efb-c11b-473a-93b4-666cb9c5ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:22.778513 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3779f-d34c-4fd7-9169-4f1a8843708c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:22.785038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb8efb-c11b-473a-93b4-666cb9c5ddaf None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:22.791284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72d017-c20c-4cbf-bee0-40fbaf48059f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:22.792024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72d017-c20c-4cbf-bee0-40fbaf48059f service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.792322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72d017-c20c-4cbf-bee0-40fbaf48059f service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.792606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72d017-c20c-4cbf-bee0-40fbaf48059f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.792841 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6e0ac-d0e3-432b-b749-3fc8a134a79a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:22.793515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e0ac-d0e3-432b-b749-3fc8a134a79a service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.793839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e0ac-d0e3-432b-b749-3fc8a134a79a service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.794123 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6e0ac-d0e3-432b-b749-3fc8a134a79a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.802014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c1c6e0ac-d0e3-432b-b749-3fc8a134a79a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:22.809311 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72d017-c20c-4cbf-bee0-40fbaf48059f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:22.811078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72d017-c20c-4cbf-bee0-40fbaf48059f service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:22.817339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6e0ac-d0e3-432b-b749-3fc8a134a79a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:22.819368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6e0ac-d0e3-432b-b749-3fc8a134a79a service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:22.831374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 829/1675] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:22.833393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50be59-49dd-487f-b906-1368a040e786 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.833726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50be59-49dd-487f-b906-1368a040e786 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.834020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50be59-49dd-487f-b906-1368a040e786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.835795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 847/1676] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:22.867868 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-dd50be59-49dd-487f-b906-1368a040e786 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:22.869730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dd50be59-49dd-487f-b906-1368a040e786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:22.893532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 830/1677] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:22.897581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72d017-c20c-4cbf-bee0-40fbaf48059f service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:22.916192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72d017-c20c-4cbf-bee0-40fbaf48059f service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:22.922046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96e45d-2e9d-44ed-b345-886ba9d8e7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:22.923094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96e45d-2e9d-44ed-b345-886ba9d8e7cb admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.923740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96e45d-2e9d-44ed-b345-886ba9d8e7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.924165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96e45d-2e9d-44ed-b345-886ba9d8e7cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.925074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96e45d-2e9d-44ed-b345-886ba9d8e7cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:22.925537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96e45d-2e9d-44ed-b345-886ba9d8e7cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:22.927443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96e45d-2e9d-44ed-b345-886ba9d8e7cb admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:22.943225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 848/1678] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:22.947669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50be59-49dd-487f-b906-1368a040e786 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:22.957898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50be59-49dd-487f-b906-1368a040e786 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:22.964108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d573-3fda-4a5e-b421-ebaec94772ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:22.965008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d573-3fda-4a5e-b421-ebaec94772ec admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:22.965479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d573-3fda-4a5e-b421-ebaec94772ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:22.965908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722d573-3fda-4a5e-b421-ebaec94772ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:22.966883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d573-3fda-4a5e-b421-ebaec94772ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:22.968996 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722d573-3fda-4a5e-b421-ebaec94772ec admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:23.023943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 831/1679] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:22 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:23.027551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96e45d-2e9d-44ed-b345-886ba9d8e7cb admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:23.040835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96e45d-2e9d-44ed-b345-886ba9d8e7cb admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:23.103659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:23.169751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836199f-dea1-473c-b82f-471efa56de8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:23.171090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836199f-dea1-473c-b82f-471efa56de8e admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:23.171569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836199f-dea1-473c-b82f-471efa56de8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:23.172135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836199f-dea1-473c-b82f-471efa56de8e admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:23.173095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836199f-dea1-473c-b82f-471efa56de8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:23.190592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836199f-dea1-473c-b82f-471efa56de8e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:23.221856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 849/1680] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:23 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:13:23.223620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d573-3fda-4a5e-b421-ebaec94772ec admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:23.242844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722d573-3fda-4a5e-b421-ebaec94772ec admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:23.281002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2924e95-75e1-4c12-b464-c47b0f47fe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:23.281752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2924e95-75e1-4c12-b464-c47b0f47fe66 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:23.282014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2924e95-75e1-4c12-b464-c47b0f47fe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:23.282324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2924e95-75e1-4c12-b464-c47b0f47fe66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:23.283071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2924e95-75e1-4c12-b464-c47b0f47fe66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:23.284727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2924e95-75e1-4c12-b464-c47b0f47fe66 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:23.301733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 832/1681] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:23.306908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836199f-dea1-473c-b82f-471efa56de8e admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:23.332159 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836199f-dea1-473c-b82f-471efa56de8e admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:23.339613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c8b0c-0308-4358-bcab-a30a22cd4c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:23.341031 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8b0c-0308-4358-bcab-a30a22cd4c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:23.341158 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8b0c-0308-4358-bcab-a30a22cd4c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:23.342324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c8b0c-0308-4358-bcab-a30a22cd4c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:23.344247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c8b0c-0308-4358-bcab-a30a22cd4c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:23.348203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c8b0c-0308-4358-bcab-a30a22cd4c7e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:23.372090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 850/1682] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:23.375935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2924e95-75e1-4c12-b464-c47b0f47fe66 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:23.400892 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2924e95-75e1-4c12-b464-c47b0f47fe66 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:23.406238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9719da1-7f9c-4872-a96c-b35910fe84d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:23.407291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9719da1-7f9c-4872-a96c-b35910fe84d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:23.407579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9719da1-7f9c-4872-a96c-b35910fe84d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:23.407860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9719da1-7f9c-4872-a96c-b35910fe84d9 admin admin] PATH_INFO: `/v3/projects/5ad17713760042549f2151eb464f55eb/users/31fd4c19a3de4c17aa84c1bd99b50386/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:23.445052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9719da1-7f9c-4872-a96c-b35910fe84d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad17713760042549f2151eb464f55eb, user_id=31fd4c19a3de4c17aa84c1bd99b50386, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:23.458568 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9719da1-7f9c-4872-a96c-b35910fe84d9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:23.486424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 833/1683] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:23 2022] PUT /identity/v3/projects/5ad17713760042549f2151eb464f55eb/users/31fd4c19a3de4c17aa84c1bd99b50386/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:23.502986 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68ba33-345a-40d5-a683-539426590790 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:23.503316 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68ba33-345a-40d5-a683-539426590790 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:23.503563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68ba33-345a-40d5-a683-539426590790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:23.569357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5f68ba33-345a-40d5-a683-539426590790 None None] MFA Rules not processed for user `31fd4c19a3de4c17aa84c1bd99b50386`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:23.572165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5f68ba33-345a-40d5-a683-539426590790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:23.744965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 851/1684] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:23.746143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9719da1-7f9c-4872-a96c-b35910fe84d9 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:23.894037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9719da1-7f9c-4872-a96c-b35910fe84d9 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:23.908650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707392d-7211-47f8-9855-ae22175a1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:23.910045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707392d-7211-47f8-9855-ae22175a1773 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:23.910323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707392d-7211-47f8-9855-ae22175a1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:23.910607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707392d-7211-47f8-9855-ae22175a1773 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:23.911324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707392d-7211-47f8-9855-ae22175a1773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:23.919713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707392d-7211-47f8-9855-ae22175a1773 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:24.006579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 834/1685] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:23 2022] POST /identity/v3/projects => generated 373 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:24.008112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68ba33-345a-40d5-a683-539426590790 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:24.025819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68ba33-345a-40d5-a683-539426590790 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:24.086090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773a93c-df8e-4cbd-a5bb-f98da873e04e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.086483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773a93c-df8e-4cbd-a5bb-f98da873e04e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.086764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773a93c-df8e-4cbd-a5bb-f98da873e04e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.088974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 835/1686] 10.222.0.66 () {54 vars in 912 bytes} [Mon Jul 11 14:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 11 14:13:24.120251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5b1ed-74ae-4b81-b009-5a192bb548b6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.120550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5b1ed-74ae-4b81-b009-5a192bb548b6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.120830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5b1ed-74ae-4b81-b009-5a192bb548b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.161409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9cf5b1ed-74ae-4b81-b009-5a192bb548b6 None None] MFA Rules not processed for user `27e8e06f381c424e915c1c0f6b0e5b97`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:24.162760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9cf5b1ed-74ae-4b81-b009-5a192bb548b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:24.178849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:24.216755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0b835-adb8-4d6f-9306-fcac550f665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:24.217928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0b835-adb8-4d6f-9306-fcac550f665b admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.217928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0b835-adb8-4d6f-9306-fcac550f665b admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.217928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0b835-adb8-4d6f-9306-fcac550f665b admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.219010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0b835-adb8-4d6f-9306-fcac550f665b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:24.220721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0b835-adb8-4d6f-9306-fcac550f665b admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:24.266530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 852/1687] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:24 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:24.276055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830143-19bf-410c-ac60-e9fdbceac6c2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.276606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830143-19bf-410c-ac60-e9fdbceac6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.277017 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830143-19bf-410c-ac60-e9fdbceac6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.295340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 836/1688] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:13:24.296856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5b1ed-74ae-4b81-b009-5a192bb548b6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:24.309789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5b1ed-74ae-4b81-b009-5a192bb548b6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:24.326006 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fdae3-eed6-4e1f-ae69-35376d52cada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:24.326980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fdae3-eed6-4e1f-ae69-35376d52cada admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.327420 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fdae3-eed6-4e1f-ae69-35376d52cada admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.327847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fdae3-eed6-4e1f-ae69-35376d52cada admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.328734 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fdae3-eed6-4e1f-ae69-35376d52cada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:24.331897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fdae3-eed6-4e1f-ae69-35376d52cada admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:24.348864 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-70830143-19bf-410c-ac60-e9fdbceac6c2 None None] MFA Rules not processed for user `4426582f945e4c90bf8debd2ecbd9769`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:24.351327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-70830143-19bf-410c-ac60-e9fdbceac6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:24.356928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 837/1689] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:24.358016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fdae3-eed6-4e1f-ae69-35376d52cada admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:24.362592 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e92fdae3-eed6-4e1f-ae69-35376d52cada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:24.381324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:24.392322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fdae3-eed6-4e1f-ae69-35376d52cada admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:24.405900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9292b7-b154-4e7a-8ff5-dbbdcda5d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:24.406630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9292b7-b154-4e7a-8ff5-dbbdcda5d3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.406913 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9292b7-b154-4e7a-8ff5-dbbdcda5d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.407190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9292b7-b154-4e7a-8ff5-dbbdcda5d3d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.407898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9292b7-b154-4e7a-8ff5-dbbdcda5d3d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:24.412336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9292b7-b154-4e7a-8ff5-dbbdcda5d3d4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:24.464101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 838/1690] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:24 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:24.465217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9292b7-b154-4e7a-8ff5-dbbdcda5d3d4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:24.469409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 853/1691] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:24.470651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70830143-19bf-410c-ac60-e9fdbceac6c2 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:24.497465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70830143-19bf-410c-ac60-e9fdbceac6c2 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:24.626251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9292b7-b154-4e7a-8ff5-dbbdcda5d3d4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:24.647811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3180f3f-1449-46ea-9516-bf3bb517bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:24.648738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180f3f-1449-46ea-9516-bf3bb517bbbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.649023 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180f3f-1449-46ea-9516-bf3bb517bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.649865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3180f3f-1449-46ea-9516-bf3bb517bbbf admin admin] PATH_INFO: `/v3/projects/0151aacfdd764cce88589e541f9fb3cf/users/c9518e33e5634767898a38e01a91c9c6/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.661544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021979a-c4e8-43cd-8268-63151dbe361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:24.662601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021979a-c4e8-43cd-8268-63151dbe361f admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.662897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021979a-c4e8-43cd-8268-63151dbe361f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.663182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021979a-c4e8-43cd-8268-63151dbe361f admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.663903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021979a-c4e8-43cd-8268-63151dbe361f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:24.666511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021979a-c4e8-43cd-8268-63151dbe361f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:24.702002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3180f3f-1449-46ea-9516-bf3bb517bbbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0151aacfdd764cce88589e541f9fb3cf, user_id=c9518e33e5634767898a38e01a91c9c6, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:24.705529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3180f3f-1449-46ea-9516-bf3bb517bbbf admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:24.722484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 854/1692] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:24 2022] POST /identity/v3/users => generated 308 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:24.726114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021979a-c4e8-43cd-8268-63151dbe361f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:24.740267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 839/1693] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:24 2022] PUT /identity/v3/projects/0151aacfdd764cce88589e541f9fb3cf/users/c9518e33e5634767898a38e01a91c9c6/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:24.746182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3180f3f-1449-46ea-9516-bf3bb517bbbf admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:24.759754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021979a-c4e8-43cd-8268-63151dbe361f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:24.928615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3180f3f-1449-46ea-9516-bf3bb517bbbf admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:24.942416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859949fb-7fa7-4664-b1b4-1c1636dbc7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:24.943220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859949fb-7fa7-4664-b1b4-1c1636dbc7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.943544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859949fb-7fa7-4664-b1b4-1c1636dbc7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.943822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859949fb-7fa7-4664-b1b4-1c1636dbc7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.944577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859949fb-7fa7-4664-b1b4-1c1636dbc7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:24.946222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859949fb-7fa7-4664-b1b4-1c1636dbc7c3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:24.946354 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477f6be-660b-4a4d-a670-0753888b9c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:24.946959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477f6be-660b-4a4d-a670-0753888b9c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:24.947251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477f6be-660b-4a4d-a670-0753888b9c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:24.947521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477f6be-660b-4a4d-a670-0753888b9c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:24.949639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477f6be-660b-4a4d-a670-0753888b9c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:24.954127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477f6be-660b-4a4d-a670-0753888b9c8b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:24.969054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 855/1694] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:24.969714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859949fb-7fa7-4664-b1b4-1c1636dbc7c3 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:24.972587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:25.002492 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 840/1695] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:13:25.004575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859949fb-7fa7-4664-b1b4-1c1636dbc7c3 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:25.007635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477f6be-660b-4a4d-a670-0753888b9c8b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:25.021720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a80c48-77f2-4079-8b91-c562e3437f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:25.023244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a80c48-77f2-4079-8b91-c562e3437f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:25.023539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a80c48-77f2-4079-8b91-c562e3437f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:25.023828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a80c48-77f2-4079-8b91-c562e3437f40 admin admin] PATH_INFO: `/v3/projects/2ed6de05edbb4c979731cbdd33806661/users/6fc4840872b64b0784ac340f91572363/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:25.034707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477f6be-660b-4a4d-a670-0753888b9c8b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:25.044309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9c796-edc6-4b73-8084-38ebc64078a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:25.046176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9c796-edc6-4b73-8084-38ebc64078a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:25.046593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9c796-edc6-4b73-8084-38ebc64078a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:25.046977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9c796-edc6-4b73-8084-38ebc64078a4 admin admin] PATH_INFO: `/v3/projects/0151aacfdd764cce88589e541f9fb3cf/users/c9518e33e5634767898a38e01a91c9c6/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:25.050030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9c796-edc6-4b73-8084-38ebc64078a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0151aacfdd764cce88589e541f9fb3cf, user_id=c9518e33e5634767898a38e01a91c9c6, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:25.053754 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9c796-edc6-4b73-8084-38ebc64078a4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:25.060390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a80c48-77f2-4079-8b91-c562e3437f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed6de05edbb4c979731cbdd33806661, user_id=6fc4840872b64b0784ac340f91572363, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:25.063284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a80c48-77f2-4079-8b91-c562e3437f40 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:25.072308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 841/1696] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:25 2022] PUT /identity/v3/projects/0151aacfdd764cce88589e541f9fb3cf/users/c9518e33e5634767898a38e01a91c9c6/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:25.085290 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58142d7-5e6c-4462-8c15-0fa91ad5475f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:25.085581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58142d7-5e6c-4462-8c15-0fa91ad5475f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:25.085859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58142d7-5e6c-4462-8c15-0fa91ad5475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:25.097905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 856/1697] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:24 2022] PUT /identity/v3/projects/2ed6de05edbb4c979731cbdd33806661/users/6fc4840872b64b0784ac340f91572363/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:25.098802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a80c48-77f2-4079-8b91-c562e3437f40 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:25.106666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c4a80c48-77f2-4079-8b91-c562e3437f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:25.161391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b58142d7-5e6c-4462-8c15-0fa91ad5475f None None] MFA Rules not processed for user `c9518e33e5634767898a38e01a91c9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:25.163350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b58142d7-5e6c-4462-8c15-0fa91ad5475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:25.223471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:25.297294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a80c48-77f2-4079-8b91-c562e3437f40 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:25.315058 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982858b-fd69-4989-b795-b3148b9f2ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:25.317342 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982858b-fd69-4989-b795-b3148b9f2ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:25.318819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982858b-fd69-4989-b795-b3148b9f2ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:25.319535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982858b-fd69-4989-b795-b3148b9f2ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:25.335450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982858b-fd69-4989-b795-b3148b9f2ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:25.341936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982858b-fd69-4989-b795-b3148b9f2ea9 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:25.364117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 857/1698] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:25.367349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982858b-fd69-4989-b795-b3148b9f2ea9 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:25.377470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 842/1699] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:25.491692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58142d7-5e6c-4462-8c15-0fa91ad5475f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:25.494107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b58142d7-5e6c-4462-8c15-0fa91ad5475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:25.582745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982858b-fd69-4989-b795-b3148b9f2ea9 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:25.597199 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e52939-839d-445a-a6a5-440f65e15c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:25.598045 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52939-839d-445a-a6a5-440f65e15c56 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:25.598462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52939-839d-445a-a6a5-440f65e15c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:25.598841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e52939-839d-445a-a6a5-440f65e15c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:25.601629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e52939-839d-445a-a6a5-440f65e15c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:25.610265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e52939-839d-445a-a6a5-440f65e15c56 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:25.642299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 858/1700] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:25.644036 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e52939-839d-445a-a6a5-440f65e15c56 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:25.670184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e52939-839d-445a-a6a5-440f65e15c56 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:25.681614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58142d7-5e6c-4462-8c15-0fa91ad5475f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:25.686779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe2b92-51c3-4bba-b730-e98625fa8111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:25.688176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe2b92-51c3-4bba-b730-e98625fa8111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:25.688659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe2b92-51c3-4bba-b730-e98625fa8111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:25.689041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe2b92-51c3-4bba-b730-e98625fa8111 admin admin] PATH_INFO: `/v3/projects/2ed6de05edbb4c979731cbdd33806661/users/6fc4840872b64b0784ac340f91572363/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:25.695283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe2b92-51c3-4bba-b730-e98625fa8111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed6de05edbb4c979731cbdd33806661, user_id=6fc4840872b64b0784ac340f91572363, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:25.695470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59665c5d-de3e-4e14-8590-543154618752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:25.697644 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59665c5d-de3e-4e14-8590-543154618752 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:25.697942 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59665c5d-de3e-4e14-8590-543154618752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:25.699469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59665c5d-de3e-4e14-8590-543154618752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:25.704260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe2b92-51c3-4bba-b730-e98625fa8111 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:25.719373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59665c5d-de3e-4e14-8590-543154618752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:25.720981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59665c5d-de3e-4e14-8590-543154618752 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:25.735523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 843/1701] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:25.746670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 859/1702] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:25 2022] PUT /identity/v3/projects/2ed6de05edbb4c979731cbdd33806661/users/6fc4840872b64b0784ac340f91572363/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:27.119851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b4bd-ccd5-47b3-9f41-03d3df21fb1d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:27.121069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b4bd-ccd5-47b3-9f41-03d3df21fb1d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:27.121507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356b4bd-ccd5-47b3-9f41-03d3df21fb1d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:27.123974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 844/1703] 10.222.0.66 () {54 vars in 960 bytes} [Mon Jul 11 14:13:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:27.137119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91badd38-00b3-4f2f-895d-de8f8bc72a9a None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:27.137645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91badd38-00b3-4f2f-895d-de8f8bc72a9a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:27.137732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91badd38-00b3-4f2f-895d-de8f8bc72a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:27.180545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356b4bd-ccd5-47b3-9f41-03d3df21fb1d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:27.236807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-91badd38-00b3-4f2f-895d-de8f8bc72a9a None None] MFA Rules not processed for user `2949783e08504cfba3dc52dcf8b6a015`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:27.243149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-91badd38-00b3-4f2f-895d-de8f8bc72a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:27.432314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356b4bd-ccd5-47b3-9f41-03d3df21fb1d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:27.441525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9606e3-564b-4a1f-8b37-df08b3b36cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:27.444682 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9606e3-564b-4a1f-8b37-df08b3b36cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:27.444970 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9606e3-564b-4a1f-8b37-df08b3b36cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:27.445750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9606e3-564b-4a1f-8b37-df08b3b36cb3 admin admin] PATH_INFO: `/v3/users/31fd4c19a3de4c17aa84c1bd99b50386` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:27.452432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9606e3-564b-4a1f-8b37-df08b3b36cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31fd4c19a3de4c17aa84c1bd99b50386)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:27.457801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9606e3-564b-4a1f-8b37-df08b3b36cb3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:27.462795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 860/1704] 10.222.0.66 () {58 vars in 1057 bytes} [Mon Jul 11 14:13:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:13:27.481878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91badd38-00b3-4f2f-895d-de8f8bc72a9a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:27.505004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:27.512817 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91badd38-00b3-4f2f-895d-de8f8bc72a9a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:27.537437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489df5c-8d3a-4a7c-bc92-d68426c5331c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:27.539683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489df5c-8d3a-4a7c-bc92-d68426c5331c service placement] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:27.541430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489df5c-8d3a-4a7c-bc92-d68426c5331c service placement] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:27.541954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489df5c-8d3a-4a7c-bc92-d68426c5331c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:27.547465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0489df5c-8d3a-4a7c-bc92-d68426c5331c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:27.583225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c9606e3-564b-4a1f-8b37-df08b3b36cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31fd4c19a3de4c17aa84c1bd99b50386'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:27.584317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c9606e3-564b-4a1f-8b37-df08b3b36cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31fd4c19a3de4c17aa84c1bd99b50386'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:27.584746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489df5c-8d3a-4a7c-bc92-d68426c5331c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:27.586412 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c9606e3-564b-4a1f-8b37-df08b3b36cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31fd4c19a3de4c17aa84c1bd99b50386'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:27.591466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489df5c-8d3a-4a7c-bc92-d68426c5331c service placement] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:27.606759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c9606e3-564b-4a1f-8b37-df08b3b36cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31fd4c19a3de4c17aa84c1bd99b50386'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:27.620746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 861/1705] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:27.660805 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c9606e3-564b-4a1f-8b37-df08b3b36cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31fd4c19a3de4c17aa84c1bd99b50386'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:27.720897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 845/1706] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:27 2022] DELETE /identity/v3/users/31fd4c19a3de4c17aa84c1bd99b50386 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:13:27.722670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f279baf-1357-45ba-9581-0401de5f4c17 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:27.723060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f279baf-1357-45ba-9581-0401de5f4c17 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:27.723330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f279baf-1357-45ba-9581-0401de5f4c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:27.782525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e6e1c-da62-4083-a28a-48b434f593b6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:27.782923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e6e1c-da62-4083-a28a-48b434f593b6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:27.783072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e6e1c-da62-4083-a28a-48b434f593b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:27.808730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0f279baf-1357-45ba-9581-0401de5f4c17 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:27.811383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0f279baf-1357-45ba-9581-0401de5f4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:27.832331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ac1e6e1c-da62-4083-a28a-48b434f593b6 None None] MFA Rules not processed for user `39a5cea0a591453581a9d98ff796d973`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:27.835842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ac1e6e1c-da62-4083-a28a-48b434f593b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:27.942119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:28.015349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 846/1707] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:13:28.015349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09a5f9-a939-4fc0-907b-981357924812 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:28.015349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09a5f9-a939-4fc0-907b-981357924812 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:28.015349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09a5f9-a939-4fc0-907b-981357924812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:28.021110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 862/1708] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:28.028907 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d5cd2-4236-418e-bceb-e01c99914878 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:28.029208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d5cd2-4236-418e-bceb-e01c99914878 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:28.029497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d5cd2-4236-418e-bceb-e01c99914878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:28.088327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6e09a5f9-a939-4fc0-907b-981357924812 None None] MFA Rules not processed for user `75f62561a96f471b9dcc660e7aa9ff60`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:28.089701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6e09a5f9-a939-4fc0-907b-981357924812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:28.157600 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-7a0d5cd2-4236-418e-bceb-e01c99914878 None None] MFA Rules not processed for user `6fc4840872b64b0784ac340f91572363`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:28.164317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7a0d5cd2-4236-418e-bceb-e01c99914878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:28.247991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 847/1709] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:28.262057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09a5f9-a939-4fc0-907b-981357924812 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:28.266803 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6e09a5f9-a939-4fc0-907b-981357924812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:28.348241 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:28.403451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 863/1710] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:28.404884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe62abe-e0cb-4dc7-91c9-de823d97acaa None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:28.407118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe62abe-e0cb-4dc7-91c9-de823d97acaa None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:28.407571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe62abe-e0cb-4dc7-91c9-de823d97acaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:28.443312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09a5f9-a939-4fc0-907b-981357924812 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:28.447026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ffe62abe-e0cb-4dc7-91c9-de823d97acaa None None] MFA Rules not processed for user `75f62561a96f471b9dcc660e7aa9ff60`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:28.451371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ffe62abe-e0cb-4dc7-91c9-de823d97acaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:28.459548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 864/1711] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:28.472660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe62abe-e0cb-4dc7-91c9-de823d97acaa None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:28.473174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef013d-9ca6-48d2-80f4-a9792ddf4207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:28.474122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef013d-9ca6-48d2-80f4-a9792ddf4207 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:28.474529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef013d-9ca6-48d2-80f4-a9792ddf4207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:28.474813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef013d-9ca6-48d2-80f4-a9792ddf4207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:28.475875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ffe62abe-e0cb-4dc7-91c9-de823d97acaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:28.496821 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef013d-9ca6-48d2-80f4-a9792ddf4207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:28.499544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef013d-9ca6-48d2-80f4-a9792ddf4207 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:28.545604 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 848/1712] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:28.683405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe62abe-e0cb-4dc7-91c9-de823d97acaa None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:28.699363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa4251-3c2d-4cbc-a42a-28407a5769b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:28.699967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa4251-3c2d-4cbc-a42a-28407a5769b4 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:28.700614 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa4251-3c2d-4cbc-a42a-28407a5769b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:28.701268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa4251-3c2d-4cbc-a42a-28407a5769b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:28.734791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa4251-3c2d-4cbc-a42a-28407a5769b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:28.736970 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa4251-3c2d-4cbc-a42a-28407a5769b4 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:28.786357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 865/1713] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:13:29.699738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef013d-9ca6-48d2-80f4-a9792ddf4207 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:29.701289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6bef013d-9ca6-48d2-80f4-a9792ddf4207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:29.733508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef013d-9ca6-48d2-80f4-a9792ddf4207 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:29.766883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce835d-42bd-45d5-9ccf-dc2889ef209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:29.767799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce835d-42bd-45d5-9ccf-dc2889ef209f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:29.768087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce835d-42bd-45d5-9ccf-dc2889ef209f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:29.768370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce835d-42bd-45d5-9ccf-dc2889ef209f admin admin] PATH_INFO: `/v3/users/17166cb363d447c688088696639b9aa7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:29.775414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce835d-42bd-45d5-9ccf-dc2889ef209f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17166cb363d447c688088696639b9aa7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:29.778578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce835d-42bd-45d5-9ccf-dc2889ef209f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:29.863877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef39b3a-5038-410d-844f-4d1184bc7fc0 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:29.864569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef39b3a-5038-410d-844f-4d1184bc7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:29.864569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef39b3a-5038-410d-844f-4d1184bc7fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:29.943525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-37ce835d-42bd-45d5-9ccf-dc2889ef209f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17166cb363d447c688088696639b9aa7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:29.944236 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-37ce835d-42bd-45d5-9ccf-dc2889ef209f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17166cb363d447c688088696639b9aa7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:29.948382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-37ce835d-42bd-45d5-9ccf-dc2889ef209f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17166cb363d447c688088696639b9aa7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:29.962005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-9ef39b3a-5038-410d-844f-4d1184bc7fc0 None None] MFA Rules not processed for user `79023e778baa45888e6ef870499e5ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:29.963348 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9ef39b3a-5038-410d-844f-4d1184bc7fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:29.976863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-37ce835d-42bd-45d5-9ccf-dc2889ef209f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17166cb363d447c688088696639b9aa7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:30.046615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-37ce835d-42bd-45d5-9ccf-dc2889ef209f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17166cb363d447c688088696639b9aa7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:30.049716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:30.131084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 866/1714] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:13:30.133180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29484ab-8de6-4384-a25c-a3cae49dd4fc None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:30.134314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29484ab-8de6-4384-a25c-a3cae49dd4fc None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:30.135343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29484ab-8de6-4384-a25c-a3cae49dd4fc None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:30.137256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 867/1715] 10.222.0.66 () {54 vars in 912 bytes} [Mon Jul 11 14:13:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:30.153008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf82dc-6b31-46d6-85ec-9ecf13627514 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:30.153471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf82dc-6b31-46d6-85ec-9ecf13627514 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:30.153900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf82dc-6b31-46d6-85ec-9ecf13627514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:30.181429 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 849/1716] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:29 2022] DELETE /identity/v3/users/17166cb363d447c688088696639b9aa7 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:30.181749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f1cf82dc-6b31-46d6-85ec-9ecf13627514 None None] MFA Rules not processed for user `4426582f945e4c90bf8debd2ecbd9769`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:30.182667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f1cf82dc-6b31-46d6-85ec-9ecf13627514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:30.184379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1ed38-9308-4223-9fc7-b2de84d5f77f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:30.186884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1ed38-9308-4223-9fc7-b2de84d5f77f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:30.189337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1ed38-9308-4223-9fc7-b2de84d5f77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:30.310702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 868/1717] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:13:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:30.319650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8dc1ed38-9308-4223-9fc7-b2de84d5f77f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:30.322146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8dc1ed38-9308-4223-9fc7-b2de84d5f77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:30.384829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf82dc-6b31-46d6-85ec-9ecf13627514 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:30.388245 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f1cf82dc-6b31-46d6-85ec-9ecf13627514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:30.410118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf82dc-6b31-46d6-85ec-9ecf13627514 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:30.418989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39cf69-1a1c-44fb-9643-769b35c3c0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:30.419961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39cf69-1a1c-44fb-9643-769b35c3c0dc service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:30.420395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39cf69-1a1c-44fb-9643-769b35c3c0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:30.420806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39cf69-1a1c-44fb-9643-769b35c3c0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:30.447715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39cf69-1a1c-44fb-9643-769b35c3c0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:30.452529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a39cf69-1a1c-44fb-9643-769b35c3c0dc service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:30.470964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 869/1718] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:30.504408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 850/1719] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:30.561905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39cf69-1a1c-44fb-9643-769b35c3c0dc service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:30.565728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7a39cf69-1a1c-44fb-9643-769b35c3c0dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:30.592405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39cf69-1a1c-44fb-9643-769b35c3c0dc service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:30.609526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515563a-ac30-4b86-9494-f0d07d7133a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:30.610236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515563a-ac30-4b86-9494-f0d07d7133a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:30.610535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515563a-ac30-4b86-9494-f0d07d7133a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:30.610821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515563a-ac30-4b86-9494-f0d07d7133a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:30.621296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1ed38-9308-4223-9fc7-b2de84d5f77f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:30.622881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8dc1ed38-9308-4223-9fc7-b2de84d5f77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:30.653873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515563a-ac30-4b86-9494-f0d07d7133a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:30.664952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515563a-ac30-4b86-9494-f0d07d7133a8 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:30.711155 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 870/1720] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:30.782999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:30.920436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1ed38-9308-4223-9fc7-b2de84d5f77f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:30.969307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e59cc4-1521-4bf4-b9c7-7cdb65322da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:30.973802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e59cc4-1521-4bf4-b9c7-7cdb65322da2 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:30.975043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e59cc4-1521-4bf4-b9c7-7cdb65322da2 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:30.977691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e59cc4-1521-4bf4-b9c7-7cdb65322da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:31.020188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515563a-ac30-4b86-9494-f0d07d7133a8 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:31.021803 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5515563a-ac30-4b86-9494-f0d07d7133a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:31.052891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515563a-ac30-4b86-9494-f0d07d7133a8 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:31.063706 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ced752-d15d-4863-b039-b58ecbd50a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:31.065178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced752-d15d-4863-b039-b58ecbd50a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:31.066146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced752-d15d-4863-b039-b58ecbd50a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:31.070300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced752-d15d-4863-b039-b58ecbd50a90 admin admin] PATH_INFO: `/v3/users/c44559fc86c149ea92c4566ccc7d521d` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:31.073615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ced752-d15d-4863-b039-b58ecbd50a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44559fc86c149ea92c4566ccc7d521d)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:31.079611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ced752-d15d-4863-b039-b58ecbd50a90 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:31.232456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e59cc4-1521-4bf4-b9c7-7cdb65322da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:31.236049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e59cc4-1521-4bf4-b9c7-7cdb65322da2 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:31.259965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-74ced752-d15d-4863-b039-b58ecbd50a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44559fc86c149ea92c4566ccc7d521d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:31.260997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-74ced752-d15d-4863-b039-b58ecbd50a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44559fc86c149ea92c4566ccc7d521d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:31.262195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-74ced752-d15d-4863-b039-b58ecbd50a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44559fc86c149ea92c4566ccc7d521d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:31.278462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 851/1721] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:31.279253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-74ced752-d15d-4863-b039-b58ecbd50a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44559fc86c149ea92c4566ccc7d521d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:31.296708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-74ced752-d15d-4863-b039-b58ecbd50a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44559fc86c149ea92c4566ccc7d521d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:31.341816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 871/1722] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:31 2022] DELETE /identity/v3/users/c44559fc86c149ea92c4566ccc7d521d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:31.343710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9231035-4f07-4e87-90dc-4b8445ce3412 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:31.343976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9231035-4f07-4e87-90dc-4b8445ce3412 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:31.344261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9231035-4f07-4e87-90dc-4b8445ce3412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:31.400108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f9231035-4f07-4e87-90dc-4b8445ce3412 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:31.401920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f9231035-4f07-4e87-90dc-4b8445ce3412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:31.495261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde5d70-8d99-4e0b-b0d1-7f746d80cd76 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:31.500291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde5d70-8d99-4e0b-b0d1-7f746d80cd76 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:31.500851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde5d70-8d99-4e0b-b0d1-7f746d80cd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:31.593444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 852/1723] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:31.635783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9231035-4f07-4e87-90dc-4b8445ce3412 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:31.639245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f9231035-4f07-4e87-90dc-4b8445ce3412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:31.655861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:31.695490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-cdde5d70-8d99-4e0b-b0d1-7f746d80cd76 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:31.697607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cdde5d70-8d99-4e0b-b0d1-7f746d80cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:31.854251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9231035-4f07-4e87-90dc-4b8445ce3412 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:31.861770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7439fbc-04d7-45a7-8e9b-5ad8286793f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:31.864506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7439fbc-04d7-45a7-8e9b-5ad8286793f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:31.864795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7439fbc-04d7-45a7-8e9b-5ad8286793f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:31.865346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7439fbc-04d7-45a7-8e9b-5ad8286793f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:31.889593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7439fbc-04d7-45a7-8e9b-5ad8286793f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:31.893267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7439fbc-04d7-45a7-8e9b-5ad8286793f4 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:31.920861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 853/1724] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:31.923829 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ec105-c56d-40c9-9a2e-6f467d00caa9 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:31.924138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 872/1725] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:13:31.924245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ec105-c56d-40c9-9a2e-6f467d00caa9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:31.924645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ec105-c56d-40c9-9a2e-6f467d00caa9 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:31.926388 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 854/1726] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:13:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:31.959884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc9c5d-c42d-4ed4-af58-0d127e9d4b40 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:31.961733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc9c5d-c42d-4ed4-af58-0d127e9d4b40 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:31.963541 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc9c5d-c42d-4ed4-af58-0d127e9d4b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:32.035284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1fbc9c5d-c42d-4ed4-af58-0d127e9d4b40 None None] MFA Rules not processed for user `2949783e08504cfba3dc52dcf8b6a015`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:32.037131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1fbc9c5d-c42d-4ed4-af58-0d127e9d4b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:32.137540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 873/1727] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:32.168649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ec105-c56d-40c9-9a2e-6f467d00caa9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:32.170803 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1b6ec105-c56d-40c9-9a2e-6f467d00caa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:32.186519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc9c5d-c42d-4ed4-af58-0d127e9d4b40 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:32.188391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1fbc9c5d-c42d-4ed4-af58-0d127e9d4b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:32.246783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc9c5d-c42d-4ed4-af58-0d127e9d4b40 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:32.254988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ec105-c56d-40c9-9a2e-6f467d00caa9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:32.265124 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:32.268539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:32.269771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:32.271254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] PATH_INFO: `/v3/projects/5ad17713760042549f2151eb464f55eb` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:32.276677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad17713760042549f2151eb464f55eb)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:32.277233 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f355-d456-4af0-82bc-b9cac8525ed4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:32.278666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f355-d456-4af0-82bc-b9cac8525ed4 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:32.280755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f355-d456-4af0-82bc-b9cac8525ed4 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:32.282809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f355-d456-4af0-82bc-b9cac8525ed4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:32.284287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:32.319678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49f355-d456-4af0-82bc-b9cac8525ed4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:32.322699 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49f355-d456-4af0-82bc-b9cac8525ed4 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:32.377266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 855/1728] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:32.404563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f355-d456-4af0-82bc-b9cac8525ed4 service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:32.418625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4e49f355-d456-4af0-82bc-b9cac8525ed4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:32.471881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad17713760042549f2151eb464f55eb', 'request_id': 'req-516df9cf-490e-4ffb-8842-224ec670c0f3'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:32.503656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad17713760042549f2151eb464f55eb', 'request_id': 'req-516df9cf-490e-4ffb-8842-224ec670c0f3'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:32.503824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:32.527655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad17713760042549f2151eb464f55eb', 'request_id': 'req-516df9cf-490e-4ffb-8842-224ec670c0f3'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:32.573339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] The token cache is being invalidate because project 5ad17713760042549f2151eb464f55eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:32.576719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:32.578533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:32.591587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 874/1729] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:32 2022] DELETE /identity/v3/projects/5ad17713760042549f2151eb464f55eb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:32.592949 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:32.596839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:32.665952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:32.814557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f355-d456-4af0-82bc-b9cac8525ed4 service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:32.850623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516df9cf-490e-4ffb-8842-224ec670c0f3 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:32.866898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:32.868869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:32.869843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:32.870312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] PATH_INFO: `/v3/users/c9518e33e5634767898a38e01a91c9c6` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:32.874623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9518e33e5634767898a38e01a91c9c6)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:32.879480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:32.976161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f044b2-6d73-49f6-aa4d-a09037d7917b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:32.977960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f044b2-6d73-49f6-aa4d-a09037d7917b service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:32.978328 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f044b2-6d73-49f6-aa4d-a09037d7917b service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:32.978538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f044b2-6d73-49f6-aa4d-a09037d7917b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:32.983383 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e5f044b2-6d73-49f6-aa4d-a09037d7917b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:33.008035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9518e33e5634767898a38e01a91c9c6'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:33.010723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9518e33e5634767898a38e01a91c9c6'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:33.012152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9518e33e5634767898a38e01a91c9c6'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:33.028089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9518e33e5634767898a38e01a91c9c6'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:33.052489 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9518e33e5634767898a38e01a91c9c6'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:33.142376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 875/1730] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:32 2022] DELETE /identity/v3/users/c9518e33e5634767898a38e01a91c9c6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:33.244400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f044b2-6d73-49f6-aa4d-a09037d7917b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:33.246098 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f044b2-6d73-49f6-aa4d-a09037d7917b service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:33.290546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 856/1731] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:13:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 892 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:13:33.952396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:33.953897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:34.165532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f1637-de25-43f7-af6a-198e5e36dcf2 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:34.191529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:34.192385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:34.192906 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:34.193337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] PATH_INFO: `/v3/projects/04521d438cec4d90942b74c8334f6e2e` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:34.194844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] RBAC: Authorizing `identity:delete_project(project_id=04521d438cec4d90942b74c8334f6e2e)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:34.197368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:34.301871 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:34.317927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04521d438cec4d90942b74c8334f6e2e', 'request_id': 'req-b5625888-4a9a-4584-98d6-e3c47686600d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:34.339671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04521d438cec4d90942b74c8334f6e2e', 'request_id': 'req-b5625888-4a9a-4584-98d6-e3c47686600d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:34.349889 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04521d438cec4d90942b74c8334f6e2e', 'request_id': 'req-b5625888-4a9a-4584-98d6-e3c47686600d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:34.373696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] The token cache is being invalidate because project 04521d438cec4d90942b74c8334f6e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:34.374550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:34.376932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:34.383655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 876/1732] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:33 2022] DELETE /identity/v3/projects/04521d438cec4d90942b74c8334f6e2e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:13:34.387615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f044b2-6d73-49f6-aa4d-a09037d7917b service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:34.389153 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e5f044b2-6d73-49f6-aa4d-a09037d7917b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:34.427126 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f044b2-6d73-49f6-aa4d-a09037d7917b service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:34.533730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:34.636833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44eea8-b5a6-4f61-81db-bd3a61ea90a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:34.638466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44eea8-b5a6-4f61-81db-bd3a61ea90a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:34.639043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44eea8-b5a6-4f61-81db-bd3a61ea90a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:34.639533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44eea8-b5a6-4f61-81db-bd3a61ea90a9 admin admin] PATH_INFO: `/v3/users/b2f762a4dd434ce2916451d13d1f07bc` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:34.641053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44eea8-b5a6-4f61-81db-bd3a61ea90a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f762a4dd434ce2916451d13d1f07bc)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:34.646799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44eea8-b5a6-4f61-81db-bd3a61ea90a9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:34.879292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3e44eea8-b5a6-4f61-81db-bd3a61ea90a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f762a4dd434ce2916451d13d1f07bc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:34.889287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3e44eea8-b5a6-4f61-81db-bd3a61ea90a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f762a4dd434ce2916451d13d1f07bc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:34.890907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3e44eea8-b5a6-4f61-81db-bd3a61ea90a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f762a4dd434ce2916451d13d1f07bc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:34.914900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3e44eea8-b5a6-4f61-81db-bd3a61ea90a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f762a4dd434ce2916451d13d1f07bc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:34.931277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3e44eea8-b5a6-4f61-81db-bd3a61ea90a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f762a4dd434ce2916451d13d1f07bc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:34.952657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 857/1733] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:34 2022] DELETE /identity/v3/users/b2f762a4dd434ce2916451d13d1f07bc => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:35.092901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:35.094884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:35.136903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5625888-4a9a-4584-98d6-e3c47686600d admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:35.440679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:35.442420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:35.442873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:35.443316 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] PATH_INFO: `/v3/users/83033c72de2f41738358a9a5f161b3c5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:35.449014 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83033c72de2f41738358a9a5f161b3c5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:35.452041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:35.607471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83033c72de2f41738358a9a5f161b3c5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:35.608917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83033c72de2f41738358a9a5f161b3c5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:35.616752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83033c72de2f41738358a9a5f161b3c5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:35.647271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83033c72de2f41738358a9a5f161b3c5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:35.667272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83033c72de2f41738358a9a5f161b3c5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:35.740463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 877/1734] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:35 2022] DELETE /identity/v3/users/83033c72de2f41738358a9a5f161b3c5 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:35.745176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef285-e7fd-40d2-a9cb-492b3c7549af None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:35.745932 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef285-e7fd-40d2-a9cb-492b3c7549af None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:35.745932 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef285-e7fd-40d2-a9cb-492b3c7549af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:35.770219 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3acef285-e7fd-40d2-a9cb-492b3c7549af None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:35.771478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3acef285-e7fd-40d2-a9cb-492b3c7549af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:35.890257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 858/1735] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:36.227284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:36.227894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef285-e7fd-40d2-a9cb-492b3c7549af None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:36.229563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:36.241511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3acef285-e7fd-40d2-a9cb-492b3c7549af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:36.281332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef285-e7fd-40d2-a9cb-492b3c7549af None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:36.303615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:36.304552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:36.304843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:36.305179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] PATH_INFO: `/v3/projects/cbc5100fc9604f2680d587ca0acccd1e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:36.311991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc5100fc9604f2680d587ca0acccd1e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:36.313989 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:36.368077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:36.380533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec30ac-fb4a-4ade-b8a9-ed6bfc6ff890 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:36.400384 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100ae30-cbfd-405d-bd72-adeb571cb224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:36.401507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ae30-cbfd-405d-bd72-adeb571cb224 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:36.402032 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ae30-cbfd-405d-bd72-adeb571cb224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:36.402686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100ae30-cbfd-405d-bd72-adeb571cb224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:36.437932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100ae30-cbfd-405d-bd72-adeb571cb224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:36.449324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100ae30-cbfd-405d-bd72-adeb571cb224 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:36.488000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 878/1736] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:36.572344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc5100fc9604f2680d587ca0acccd1e', 'request_id': 'req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:36.593276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:36.620713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc5100fc9604f2680d587ca0acccd1e', 'request_id': 'req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:36.660045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc5100fc9604f2680d587ca0acccd1e', 'request_id': 'req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:36.735603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] The token cache is being invalidate because project cbc5100fc9604f2680d587ca0acccd1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:36.741291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:36.743583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf22b739-8ae2-4ead-bb4e-ffad7d3b4fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:36.760627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 859/1737] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:36 2022] DELETE /identity/v3/projects/cbc5100fc9604f2680d587ca0acccd1e => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:36.766411 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aa049-6473-4bf7-a024-056a5f8cdc57 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:36.767279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aa049-6473-4bf7-a024-056a5f8cdc57 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:36.767933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aa049-6473-4bf7-a024-056a5f8cdc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:36.857946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b65aa049-6473-4bf7-a024-056a5f8cdc57 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:36.868060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b65aa049-6473-4bf7-a024-056a5f8cdc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:37.017402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 879/1738] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:37.019369 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50afc8-6eff-4b1e-890e-2c3b7e0800f3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:37.019579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50afc8-6eff-4b1e-890e-2c3b7e0800f3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:37.019858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50afc8-6eff-4b1e-890e-2c3b7e0800f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:37.066966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ce50afc8-6eff-4b1e-890e-2c3b7e0800f3 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:37.072021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ce50afc8-6eff-4b1e-890e-2c3b7e0800f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:37.094994 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65aa049-6473-4bf7-a024-056a5f8cdc57 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:37.095183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 860/1739] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:37.115224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65aa049-6473-4bf7-a024-056a5f8cdc57 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:37.128069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2376bf-fb0a-4557-9793-dfbb05ba9f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:37.128826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2376bf-fb0a-4557-9793-dfbb05ba9f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:37.129118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2376bf-fb0a-4557-9793-dfbb05ba9f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:37.129399 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2376bf-fb0a-4557-9793-dfbb05ba9f10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:37.130150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2376bf-fb0a-4557-9793-dfbb05ba9f10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:37.130506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2376bf-fb0a-4557-9793-dfbb05ba9f10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:37.132376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2376bf-fb0a-4557-9793-dfbb05ba9f10 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:37.197905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50afc8-6eff-4b1e-890e-2c3b7e0800f3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:37.202835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 880/1740] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:13:37.230231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50afc8-6eff-4b1e-890e-2c3b7e0800f3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:37.253370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c22695-f83e-4261-a119-696dfca5a296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:37.254419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c22695-f83e-4261-a119-696dfca5a296 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:37.256530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c22695-f83e-4261-a119-696dfca5a296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:37.257860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c22695-f83e-4261-a119-696dfca5a296 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:37.260625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c22695-f83e-4261-a119-696dfca5a296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:37.265036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c22695-f83e-4261-a119-696dfca5a296 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:37.341662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2376bf-fb0a-4557-9793-dfbb05ba9f10 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:37.347652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1d2376bf-fb0a-4557-9793-dfbb05ba9f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:37.371686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 861/1741] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:37 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:37.376300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c22695-f83e-4261-a119-696dfca5a296 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:37.380108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2376bf-fb0a-4557-9793-dfbb05ba9f10 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:37.538575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:37.539872 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:37.540502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:37.541175 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] PATH_INFO: `/v3/projects/0151aacfdd764cce88589e541f9fb3cf` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:37.542604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0151aacfdd764cce88589e541f9fb3cf)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:37.544651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:37.623662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0151aacfdd764cce88589e541f9fb3cf', 'request_id': 'req-dc20b62e-5697-4ae9-aa12-e164c0ab27be'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:37.649948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0151aacfdd764cce88589e541f9fb3cf', 'request_id': 'req-dc20b62e-5697-4ae9-aa12-e164c0ab27be'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:37.658321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0151aacfdd764cce88589e541f9fb3cf', 'request_id': 'req-dc20b62e-5697-4ae9-aa12-e164c0ab27be'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:37.691006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] The token cache is being invalidate because project 0151aacfdd764cce88589e541f9fb3cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:37.692971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:37.694098 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c22695-f83e-4261-a119-696dfca5a296 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:37.694619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-dc20b62e-5697-4ae9-aa12-e164c0ab27be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:37.703444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 881/1742] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:37 2022] DELETE /identity/v3/projects/0151aacfdd764cce88589e541f9fb3cf => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:37.705090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9cea0-b004-4bac-a994-573ce88e26a5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:37.706701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9cea0-b004-4bac-a994-573ce88e26a5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:37.707614 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9cea0-b004-4bac-a994-573ce88e26a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:37.765629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:37.777944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-aef9cea0-b004-4bac-a994-573ce88e26a5 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:37.780939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-aef9cea0-b004-4bac-a994-573ce88e26a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:37.928790 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c812b-bb0e-4b2a-99cc-9f44c6f487ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:37.936454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c812b-bb0e-4b2a-99cc-9f44c6f487ed admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:37.936967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c812b-bb0e-4b2a-99cc-9f44c6f487ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:37.937498 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c812b-bb0e-4b2a-99cc-9f44c6f487ed admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:37.938683 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c812b-bb0e-4b2a-99cc-9f44c6f487ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:37.941659 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c812b-bb0e-4b2a-99cc-9f44c6f487ed admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:37.974131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 882/1743] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:37.982727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3e79-23e2-480e-bbef-e2f106187cd4 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:37.983239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3e79-23e2-480e-bbef-e2f106187cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:37.983586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3e79-23e2-480e-bbef-e2f106187cd4 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:37.985524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 883/1744] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:13:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:37.993719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f540-b47c-4e15-8695-a06275ed8073 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:37.994123 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f540-b47c-4e15-8695-a06275ed8073 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:37.994794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1f540-b47c-4e15-8695-a06275ed8073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:38.048286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a3d1f540-b47c-4e15-8695-a06275ed8073 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:38.053799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 862/1745] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:37 2022] POST /identity/v3/users => generated 293 bytes in 678 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:38.069621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c812b-bb0e-4b2a-99cc-9f44c6f487ed admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:38.072362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a3d1f540-b47c-4e15-8695-a06275ed8073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:38.074940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-172c812b-bb0e-4b2a-99cc-9f44c6f487ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:38.114956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 884/1746] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:38.116625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31ed06-518f-4c27-8f59-f7fdaef3ba53 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:38.119948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31ed06-518f-4c27-8f59-f7fdaef3ba53 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:38.120414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31ed06-518f-4c27-8f59-f7fdaef3ba53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:38.159441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c812b-bb0e-4b2a-99cc-9f44c6f487ed admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:38.185627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84591e06-35b5-4b06-90e5-d28154ef8528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:38.186777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84591e06-35b5-4b06-90e5-d28154ef8528 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:38.187064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84591e06-35b5-4b06-90e5-d28154ef8528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:38.187344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84591e06-35b5-4b06-90e5-d28154ef8528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:38.188099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84591e06-35b5-4b06-90e5-d28154ef8528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:38.191611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84591e06-35b5-4b06-90e5-d28154ef8528 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:38.193955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-9c31ed06-518f-4c27-8f59-f7fdaef3ba53 None None] MFA Rules not processed for user `2949783e08504cfba3dc52dcf8b6a015`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:38.195373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9c31ed06-518f-4c27-8f59-f7fdaef3ba53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:38.206214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 863/1747] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:38.207270 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84591e06-35b5-4b06-90e5-d28154ef8528 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:38.235397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84591e06-35b5-4b06-90e5-d28154ef8528 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:38.243325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc804b80-d14e-45d2-8ace-f8b25bf82379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:38.244181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804b80-d14e-45d2-8ace-f8b25bf82379 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:38.244585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804b80-d14e-45d2-8ace-f8b25bf82379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:38.245058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804b80-d14e-45d2-8ace-f8b25bf82379 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:38.247332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc804b80-d14e-45d2-8ace-f8b25bf82379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:38.247792 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc804b80-d14e-45d2-8ace-f8b25bf82379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:38.250565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc804b80-d14e-45d2-8ace-f8b25bf82379 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:38.272495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 864/1748] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:38.274479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc804b80-d14e-45d2-8ace-f8b25bf82379 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:38.276580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fc804b80-d14e-45d2-8ace-f8b25bf82379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:38.295953 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc804b80-d14e-45d2-8ace-f8b25bf82379 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:38.305602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:38.308093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:38.309091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:38.311139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] PATH_INFO: `/v3/users/27e8e06f381c424e915c1c0f6b0e5b97` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:38.317134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e8e06f381c424e915c1c0f6b0e5b97)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:38.321902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:38.350653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 885/1749] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:38.359215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31ed06-518f-4c27-8f59-f7fdaef3ba53 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:38.395125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31ed06-518f-4c27-8f59-f7fdaef3ba53 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:38.403422 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:38.428423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0b98-8635-4621-b629-de580fbbb924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:38.429109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0b98-8635-4621-b629-de580fbbb924 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:38.429390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0b98-8635-4621-b629-de580fbbb924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:38.429674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a0b98-8635-4621-b629-de580fbbb924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:38.430497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a0b98-8635-4621-b629-de580fbbb924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:38.432154 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a0b98-8635-4621-b629-de580fbbb924 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:38.479693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 886/1750] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:38.482454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0b98-8635-4621-b629-de580fbbb924 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:38.509504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e8e06f381c424e915c1c0f6b0e5b97'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:38.510272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e8e06f381c424e915c1c0f6b0e5b97'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:38.512873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a0b98-8635-4621-b629-de580fbbb924 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:38.513865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e8e06f381c424e915c1c0f6b0e5b97'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:38.536108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba85f1b-84a4-4313-84fb-a36f20bc03db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:38.536936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e8e06f381c424e915c1c0f6b0e5b97'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:38.539414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba85f1b-84a4-4313-84fb-a36f20bc03db admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:38.540466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba85f1b-84a4-4313-84fb-a36f20bc03db admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:38.541804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba85f1b-84a4-4313-84fb-a36f20bc03db admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:38.542734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba85f1b-84a4-4313-84fb-a36f20bc03db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:38.546001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba85f1b-84a4-4313-84fb-a36f20bc03db admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:38.580242 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e8e06f381c424e915c1c0f6b0e5b97'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:38.610582 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 865/1751] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:38 2022] DELETE /identity/v3/users/27e8e06f381c424e915c1c0f6b0e5b97 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:38.610582 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:38.616302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:38.632562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 887/1752] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:38 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:38.636245 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba85f1b-84a4-4313-84fb-a36f20bc03db admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:38.644013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5ba85f1b-84a4-4313-84fb-a36f20bc03db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:38.854270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba85f1b-84a4-4313-84fb-a36f20bc03db admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:38.869548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75011d-8293-4ff5-aefe-becee19bc850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:38.871310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75011d-8293-4ff5-aefe-becee19bc850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:38.871725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75011d-8293-4ff5-aefe-becee19bc850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:38.872293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75011d-8293-4ff5-aefe-becee19bc850 admin admin] PATH_INFO: `/v3/projects/c9d0ba4d5ab242b59edc1ae0dd823d63/users/c47fe6f6ad044e078ac010cf881857fc/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:38.903230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:38.915531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4906b11-32ce-495f-a7e5-35ebda69fad4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:38.941401 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75011d-8293-4ff5-aefe-becee19bc850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d0ba4d5ab242b59edc1ae0dd823d63, user_id=c47fe6f6ad044e078ac010cf881857fc, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:38.947971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75011d-8293-4ff5-aefe-becee19bc850 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:38.984684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 888/1753] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:38 2022] PUT /identity/v3/projects/c9d0ba4d5ab242b59edc1ae0dd823d63/users/c47fe6f6ad044e078ac010cf881857fc/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:38.987432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75011d-8293-4ff5-aefe-becee19bc850 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:38.997205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0b75011d-8293-4ff5-aefe-becee19bc850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:39.241005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a063c67-4e6a-4b5d-8ace-0d4fc0d9d10d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:39.246606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a063c67-4e6a-4b5d-8ace-0d4fc0d9d10d service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:39.247134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a063c67-4e6a-4b5d-8ace-0d4fc0d9d10d service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:39.247565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a063c67-4e6a-4b5d-8ace-0d4fc0d9d10d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:39.251918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4a063c67-4e6a-4b5d-8ace-0d4fc0d9d10d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:39.292067 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75011d-8293-4ff5-aefe-becee19bc850 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:39.304226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a063c67-4e6a-4b5d-8ace-0d4fc0d9d10d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:39.309952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a063c67-4e6a-4b5d-8ace-0d4fc0d9d10d service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:39.312576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba28a9-f92a-46cb-9709-6ad39e5f6ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:39.318894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba28a9-f92a-46cb-9709-6ad39e5f6ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:39.319423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba28a9-f92a-46cb-9709-6ad39e5f6ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:39.319853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba28a9-f92a-46cb-9709-6ad39e5f6ffa admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:39.321490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba28a9-f92a-46cb-9709-6ad39e5f6ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:39.325470 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba28a9-f92a-46cb-9709-6ad39e5f6ffa admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:39.371820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 866/1754] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:39.387216 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6839da0-f200-435a-8ab5-57d690c7f268 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:39.387517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6839da0-f200-435a-8ab5-57d690c7f268 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:39.395658 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6839da0-f200-435a-8ab5-57d690c7f268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:39.397890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 889/1755] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:38 2022] POST /identity/v3/users => generated 283 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:39.404415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba28a9-f92a-46cb-9709-6ad39e5f6ffa admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:39.449139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba28a9-f92a-46cb-9709-6ad39e5f6ffa admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:39.480160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b1dc9-2ac8-40f4-a3c2-483104fdf8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:39.480160 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b1dc9-2ac8-40f4-a3c2-483104fdf8df admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:39.483762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b1dc9-2ac8-40f4-a3c2-483104fdf8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:39.484186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b1dc9-2ac8-40f4-a3c2-483104fdf8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:39.485202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b1dc9-2ac8-40f4-a3c2-483104fdf8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:39.489312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b1dc9-2ac8-40f4-a3c2-483104fdf8df admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:39.514460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b6839da0-f200-435a-8ab5-57d690c7f268 None None] MFA Rules not processed for user `c47fe6f6ad044e078ac010cf881857fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:39.518096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b6839da0-f200-435a-8ab5-57d690c7f268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:39.525047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 890/1756] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:39.530968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b1dc9-2ac8-40f4-a3c2-483104fdf8df admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:39.543168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:39.558086 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b1dc9-2ac8-40f4-a3c2-483104fdf8df admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:39.574298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec78432-abbc-4e7d-9ad8-93c605a29f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:39.576428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec78432-abbc-4e7d-9ad8-93c605a29f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:39.577716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec78432-abbc-4e7d-9ad8-93c605a29f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:39.579222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec78432-abbc-4e7d-9ad8-93c605a29f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:39.581539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec78432-abbc-4e7d-9ad8-93c605a29f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:39.585359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec78432-abbc-4e7d-9ad8-93c605a29f46 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:39.623657 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 891/1757] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:39.627211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec78432-abbc-4e7d-9ad8-93c605a29f46 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:39.658187 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec78432-abbc-4e7d-9ad8-93c605a29f46 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:39.676464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067c4fa-cae5-452f-b6db-7b17dcac075e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:39.679139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067c4fa-cae5-452f-b6db-7b17dcac075e admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:39.681671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067c4fa-cae5-452f-b6db-7b17dcac075e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:39.682216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067c4fa-cae5-452f-b6db-7b17dcac075e admin admin] PATH_INFO: `/v3/projects/05f3b006e92148c5aca409f5a00a82d5/users/f2b13142a24b4072bef484457b81db0d/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:39.705041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 867/1758] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:39.707221 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6839da0-f200-435a-8ab5-57d690c7f268 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:39.734302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6839da0-f200-435a-8ab5-57d690c7f268 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:39.736616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067c4fa-cae5-452f-b6db-7b17dcac075e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f3b006e92148c5aca409f5a00a82d5, user_id=f2b13142a24b4072bef484457b81db0d, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:39.748854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067c4fa-cae5-452f-b6db-7b17dcac075e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:39.749239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c6ac6-e8e9-4411-a24f-53452e16fb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:39.749948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c6ac6-e8e9-4411-a24f-53452e16fb0c admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:39.756349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c6ac6-e8e9-4411-a24f-53452e16fb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:39.756349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c6ac6-e8e9-4411-a24f-53452e16fb0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:39.756349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c6ac6-e8e9-4411-a24f-53452e16fb0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:39.760797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c6ac6-e8e9-4411-a24f-53452e16fb0c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:39.802216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 892/1759] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:39 2022] PUT /identity/v3/projects/05f3b006e92148c5aca409f5a00a82d5/users/f2b13142a24b4072bef484457b81db0d/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:39.802216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067c4fa-cae5-452f-b6db-7b17dcac075e admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:39.808022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3067c4fa-cae5-452f-b6db-7b17dcac075e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:39.822852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 868/1760] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:39 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:39.824447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a43de-b64b-4462-8201-e8e888c7e393 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:39.825928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a43de-b64b-4462-8201-e8e888c7e393 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:39.826103 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a43de-b64b-4462-8201-e8e888c7e393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:39.898031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c73a43de-b64b-4462-8201-e8e888c7e393 None None] MFA Rules not processed for user `f2b13142a24b4072bef484457b81db0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:39.899715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c73a43de-b64b-4462-8201-e8e888c7e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:40.057720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 869/1761] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:40.058603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a43de-b64b-4462-8201-e8e888c7e393 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:40.164917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067c4fa-cae5-452f-b6db-7b17dcac075e admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:40.204607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a43de-b64b-4462-8201-e8e888c7e393 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:40.220333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5f653-0328-436a-922f-46c86f6196eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:40.221097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f653-0328-436a-922f-46c86f6196eb admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:40.221902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f653-0328-436a-922f-46c86f6196eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:40.221902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5f653-0328-436a-922f-46c86f6196eb admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:40.222541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5f653-0328-436a-922f-46c86f6196eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:40.224745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5f653-0328-436a-922f-46c86f6196eb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:40.264789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 870/1762] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:40 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:40.268922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5f653-0328-436a-922f-46c86f6196eb admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:40.301238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5f653-0328-436a-922f-46c86f6196eb admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:40.320288 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1beb6-c932-40a0-9d4b-16171089ef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:40.323326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1beb6-c932-40a0-9d4b-16171089ef76 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:40.324396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1beb6-c932-40a0-9d4b-16171089ef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:40.324687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1beb6-c932-40a0-9d4b-16171089ef76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:40.327266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1beb6-c932-40a0-9d4b-16171089ef76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:40.334617 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1beb6-c932-40a0-9d4b-16171089ef76 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:40.364667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:40.376081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:40.420021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 871/1763] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:40 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:40.425740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1beb6-c932-40a0-9d4b-16171089ef76 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:40.440840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:40.442249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:40.445193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:40.448014 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] PATH_INFO: `/v3/projects/2ea31890c170427f9c3c5c3f2c442e21` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:40.451210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea31890c170427f9c3c5c3f2c442e21)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:40.453854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:40.642982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1beb6-c932-40a0-9d4b-16171089ef76 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:40.672226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea31890c170427f9c3c5c3f2c442e21', 'request_id': 'req-211e3f4c-6ab2-4565-b7d2-2b8c618af006'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:40.692042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea31890c170427f9c3c5c3f2c442e21', 'request_id': 'req-211e3f4c-6ab2-4565-b7d2-2b8c618af006'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:40.719673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea31890c170427f9c3c5c3f2c442e21', 'request_id': 'req-211e3f4c-6ab2-4565-b7d2-2b8c618af006'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:40.757973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] The token cache is being invalidate because project 2ea31890c170427f9c3c5c3f2c442e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:40.758790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:40.761080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:40.763651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 893/1764] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:39 2022] DELETE /identity/v3/projects/2ea31890c170427f9c3c5c3f2c442e21 => generated 0 bytes in 967 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:40.766703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:40.771769 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:40.825997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a82466-e05c-4f57-84e2-8db3d130e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:40.826748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a82466-e05c-4f57-84e2-8db3d130e9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:40.827100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a82466-e05c-4f57-84e2-8db3d130e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:40.827389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a82466-e05c-4f57-84e2-8db3d130e9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:40.834100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a82466-e05c-4f57-84e2-8db3d130e9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:40.835825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a82466-e05c-4f57-84e2-8db3d130e9ae admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:40.870949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 872/1765] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:40.874620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e243f8-c58a-4736-b897-786114be5942 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:40.874934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e243f8-c58a-4736-b897-786114be5942 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:40.875213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e243f8-c58a-4736-b897-786114be5942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:40.935485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c7e243f8-c58a-4736-b897-786114be5942 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:40.936700 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c7e243f8-c58a-4736-b897-786114be5942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:40.973836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 873/1766] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:40.976294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e3f4c-6ab2-4565-b7d2-2b8c618af006 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:40.976584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e243f8-c58a-4736-b897-786114be5942 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:40.980995 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c7e243f8-c58a-4736-b897-786114be5942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:40.996107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efef9f-b9df-4eb2-8052-c28cc7cc54f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:40.996821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efef9f-b9df-4eb2-8052-c28cc7cc54f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:40.997126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efef9f-b9df-4eb2-8052-c28cc7cc54f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:40.997406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efef9f-b9df-4eb2-8052-c28cc7cc54f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:40.998536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efef9f-b9df-4eb2-8052-c28cc7cc54f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:41.000818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efef9f-b9df-4eb2-8052-c28cc7cc54f6 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:41.015005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e243f8-c58a-4736-b897-786114be5942 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:41.028919 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3824b69-3dc0-46e8-a142-339b66b5db91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:41.029903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3824b69-3dc0-46e8-a142-339b66b5db91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:41.030122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3824b69-3dc0-46e8-a142-339b66b5db91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:41.030426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3824b69-3dc0-46e8-a142-339b66b5db91 admin admin] PATH_INFO: `/v3/projects/7ff29930e36643cda5caa063ff517937/users/df48869402d04c58b35e046a041bc276/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:41.079113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3824b69-3dc0-46e8-a142-339b66b5db91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff29930e36643cda5caa063ff517937, user_id=df48869402d04c58b35e046a041bc276, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:41.083577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 894/1767] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:40 2022] POST /identity/v3/users => generated 289 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:41.090500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3824b69-3dc0-46e8-a142-339b66b5db91 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:41.091606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad299c-5722-45e9-8bf2-b8bbfc66c107 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:41.092030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad299c-5722-45e9-8bf2-b8bbfc66c107 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:41.092361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad299c-5722-45e9-8bf2-b8bbfc66c107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:41.139992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 874/1768] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:40 2022] PUT /identity/v3/projects/7ff29930e36643cda5caa063ff517937/users/df48869402d04c58b35e046a041bc276/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:41.143518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d97298-5af9-463f-a75f-8ab5a9a6545f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:41.145054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d97298-5af9-463f-a75f-8ab5a9a6545f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:41.146141 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d97298-5af9-463f-a75f-8ab5a9a6545f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:41.193173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d2ad299c-5722-45e9-8bf2-b8bbfc66c107 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:41.199166 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d2ad299c-5722-45e9-8bf2-b8bbfc66c107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:41.202911 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d2d97298-5af9-463f-a75f-8ab5a9a6545f None None] MFA Rules not processed for user `4426582f945e4c90bf8debd2ecbd9769`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:41.213780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d2d97298-5af9-463f-a75f-8ab5a9a6545f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:41.360534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:41.384072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 895/1769] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:41.386414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad299c-5722-45e9-8bf2-b8bbfc66c107 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:41.413104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad299c-5722-45e9-8bf2-b8bbfc66c107 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:41.426551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6161730-9490-47e0-bef3-0d26c552bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:41.427350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6161730-9490-47e0-bef3-0d26c552bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:41.427741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6161730-9490-47e0-bef3-0d26c552bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:41.428067 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6161730-9490-47e0-bef3-0d26c552bb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:41.428927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6161730-9490-47e0-bef3-0d26c552bb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:41.437408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6161730-9490-47e0-bef3-0d26c552bb49 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:41.465268 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 875/1770] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Jul 11 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:41.468019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d97298-5af9-463f-a75f-8ab5a9a6545f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:41.473251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 896/1771] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:41.473251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6161730-9490-47e0-bef3-0d26c552bb49 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:41.478630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a6161730-9490-47e0-bef3-0d26c552bb49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:41.510467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6161730-9490-47e0-bef3-0d26c552bb49 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:41.515370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d97298-5af9-463f-a75f-8ab5a9a6545f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:41.529063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:41.530142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:41.530456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:41.530739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] PATH_INFO: `/v3/projects/043226a7fcbf40d293cce057172a94fb` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:41.532179 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043226a7fcbf40d293cce057172a94fb)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:41.534335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:41.551813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf824-0199-4caa-8cb9-ac18e8d01b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:41.552526 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf824-0199-4caa-8cb9-ac18e8d01b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:41.552804 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf824-0199-4caa-8cb9-ac18e8d01b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:41.553080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdf824-0199-4caa-8cb9-ac18e8d01b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:41.553839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf824-0199-4caa-8cb9-ac18e8d01b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:41.556113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdf824-0199-4caa-8cb9-ac18e8d01b99 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:41.593709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 876/1772] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:41.598032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf824-0199-4caa-8cb9-ac18e8d01b99 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:41.640763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:41.663302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdf824-0199-4caa-8cb9-ac18e8d01b99 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:41.687011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043226a7fcbf40d293cce057172a94fb', 'request_id': 'req-9c351184-4745-4eef-a710-024bc71198d1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:41.743927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043226a7fcbf40d293cce057172a94fb', 'request_id': 'req-9c351184-4745-4eef-a710-024bc71198d1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:41.786861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043226a7fcbf40d293cce057172a94fb', 'request_id': 'req-9c351184-4745-4eef-a710-024bc71198d1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:41.830007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] The token cache is being invalidate because project 043226a7fcbf40d293cce057172a94fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:41.830394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:41.839956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:41.847665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 897/1773] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:41 2022] DELETE /identity/v3/projects/043226a7fcbf40d293cce057172a94fb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:41.848664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:41.853510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:41.926441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31110d-b6a1-4fdb-9981-601f84a1cdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:41.927185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31110d-b6a1-4fdb-9981-601f84a1cdde admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:41.927407 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31110d-b6a1-4fdb-9981-601f84a1cdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:41.927697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31110d-b6a1-4fdb-9981-601f84a1cdde admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:41.928502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31110d-b6a1-4fdb-9981-601f84a1cdde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:41.934561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31110d-b6a1-4fdb-9981-601f84a1cdde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:41.943263 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31110d-b6a1-4fdb-9981-601f84a1cdde admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:41.990475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 877/1774] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:41.991362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31110d-b6a1-4fdb-9981-601f84a1cdde admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:41.998731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fb31110d-b6a1-4fdb-9981-601f84a1cdde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:42.036795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c351184-4745-4eef-a710-024bc71198d1 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:42.051593 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a2f15-a4d8-447b-a34e-3d14c8e3823e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:42.053298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a2f15-a4d8-447b-a34e-3d14c8e3823e admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:42.053869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a2f15-a4d8-447b-a34e-3d14c8e3823e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:42.055567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a2f15-a4d8-447b-a34e-3d14c8e3823e admin admin] PATH_INFO: `/v3/projects/74ac2d84ea5146cd8f45a58f827fe0cd/users/0df10590fd02440fb385055c90c8258e/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:42.144430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a2f15-a4d8-447b-a34e-3d14c8e3823e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ac2d84ea5146cd8f45a58f827fe0cd, user_id=0df10590fd02440fb385055c90c8258e, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:42.158440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a2f15-a4d8-447b-a34e-3d14c8e3823e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:42.187382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31110d-b6a1-4fdb-9981-601f84a1cdde admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:42.189203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 898/1775] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:41 2022] PUT /identity/v3/projects/74ac2d84ea5146cd8f45a58f827fe0cd/users/0df10590fd02440fb385055c90c8258e/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:42.239825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a2f15-a4d8-447b-a34e-3d14c8e3823e admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:42.249555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2a2a2f15-a4d8-447b-a34e-3d14c8e3823e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:42.320457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74183298-f2b1-4df9-a331-73f153a7cfd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:42.321151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74183298-f2b1-4df9-a331-73f153a7cfd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:42.321622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74183298-f2b1-4df9-a331-73f153a7cfd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:42.321909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74183298-f2b1-4df9-a331-73f153a7cfd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:42.325969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-74183298-f2b1-4df9-a331-73f153a7cfd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:42.356662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74183298-f2b1-4df9-a331-73f153a7cfd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:42.359136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74183298-f2b1-4df9-a331-73f153a7cfd3 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:42.361467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:42.391290 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a2f15-a4d8-447b-a34e-3d14c8e3823e admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:42.395315 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 878/1776] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:42.396513 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74183298-f2b1-4df9-a331-73f153a7cfd3 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:42.409748 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29ec21-2cf1-4f75-98ca-a6f5a6feb1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:42.413292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29ec21-2cf1-4f75-98ca-a6f5a6feb1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:42.413726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29ec21-2cf1-4f75-98ca-a6f5a6feb1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:42.418413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29ec21-2cf1-4f75-98ca-a6f5a6feb1ee admin admin] PATH_INFO: `/v3/projects/7ff29930e36643cda5caa063ff517937/users/df48869402d04c58b35e046a041bc276/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:42.423061 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29ec21-2cf1-4f75-98ca-a6f5a6feb1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff29930e36643cda5caa063ff517937, user_id=df48869402d04c58b35e046a041bc276, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:42.424308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74183298-f2b1-4df9-a331-73f153a7cfd3 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:42.433128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e29ec21-2cf1-4f75-98ca-a6f5a6feb1ee admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:42.436875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00563b4-7554-4c95-b15f-53c7f832eda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:42.437730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00563b4-7554-4c95-b15f-53c7f832eda6 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:42.438200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00563b4-7554-4c95-b15f-53c7f832eda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:42.438591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00563b4-7554-4c95-b15f-53c7f832eda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:42.462217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 899/1777] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:42 2022] PUT /identity/v3/projects/7ff29930e36643cda5caa063ff517937/users/df48869402d04c58b35e046a041bc276/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:42.463466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29ec21-2cf1-4f75-98ca-a6f5a6feb1ee admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:42.472843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3e29ec21-2cf1-4f75-98ca-a6f5a6feb1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:42.474413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00563b4-7554-4c95-b15f-53c7f832eda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:42.482193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00563b4-7554-4c95-b15f-53c7f832eda6 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:42.504175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 879/1778] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:42.505850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00563b4-7554-4c95-b15f-53c7f832eda6 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:42.507729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c00563b4-7554-4c95-b15f-53c7f832eda6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:42.526732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00563b4-7554-4c95-b15f-53c7f832eda6 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:42.588796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:42.628461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:42.629553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:42.631539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:42.632750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] PATH_INFO: `/v3/projects/57fb45f23b174649b0fb9e73033218fb` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:42.634457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=57fb45f23b174649b0fb9e73033218fb)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:42.640282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:42.643875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29ec21-2cf1-4f75-98ca-a6f5a6feb1ee admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:42.658533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:42.660442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:42.660442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:42.662035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] PATH_INFO: `/v3/users/6fc4840872b64b0784ac340f91572363` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:42.665928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc4840872b64b0784ac340f91572363)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:42.669719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:42.825416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57fb45f23b174649b0fb9e73033218fb', 'request_id': 'req-a2241074-91c0-4d71-b6a8-8a9273376a0d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:42.836464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57fb45f23b174649b0fb9e73033218fb', 'request_id': 'req-a2241074-91c0-4d71-b6a8-8a9273376a0d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:42.837619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc4840872b64b0784ac340f91572363'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:42.845317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc4840872b64b0784ac340f91572363'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:42.848393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc4840872b64b0784ac340f91572363'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:42.850790 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57fb45f23b174649b0fb9e73033218fb', 'request_id': 'req-a2241074-91c0-4d71-b6a8-8a9273376a0d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:42.870626 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc4840872b64b0784ac340f91572363'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:42.881656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] The token cache is being invalidate because project 57fb45f23b174649b0fb9e73033218fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:42.882320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:42.886366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc4840872b64b0784ac340f91572363'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:42.886767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:42.907532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 880/1779] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:42 2022] DELETE /identity/v3/projects/57fb45f23b174649b0fb9e73033218fb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:42.908391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:42.916530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:42.941182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 900/1780] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:42 2022] DELETE /identity/v3/users/6fc4840872b64b0784ac340f91572363 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:42.942464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:42.944585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:43.122733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0a81-e7a5-44d2-b0ab-1a9f19e44ba9 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:43.144781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a79683-58f2-4370-b29d-b41d5cb97e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:43.145967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79683-58f2-4370-b29d-b41d5cb97e80 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:43.149712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79683-58f2-4370-b29d-b41d5cb97e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:43.151547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79683-58f2-4370-b29d-b41d5cb97e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:43.152489 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a79683-58f2-4370-b29d-b41d5cb97e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:43.158827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a79683-58f2-4370-b29d-b41d5cb97e80 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:43.175018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241074-91c0-4d71-b6a8-8a9273376a0d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:43.181120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 901/1781] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:43.182259 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a79683-58f2-4370-b29d-b41d5cb97e80 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:43.184170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-65a79683-58f2-4370-b29d-b41d5cb97e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:43.190097 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:43.209871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f115b-cf5f-4fc4-a7f4-8d01e2af9323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:43.212019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f115b-cf5f-4fc4-a7f4-8d01e2af9323 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:43.213656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f115b-cf5f-4fc4-a7f4-8d01e2af9323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:43.215342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f115b-cf5f-4fc4-a7f4-8d01e2af9323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:43.218445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f115b-cf5f-4fc4-a7f4-8d01e2af9323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:43.226573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f115b-cf5f-4fc4-a7f4-8d01e2af9323 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:43.310085 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 881/1782] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:42 2022] POST /identity/v3/projects => generated 401 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:43.322978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4aca-d2f3-46eb-8129-9121e5d16fdb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:43.323312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4aca-d2f3-46eb-8129-9121e5d16fdb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:43.323689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b4aca-d2f3-46eb-8129-9121e5d16fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:43.324150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a79683-58f2-4370-b29d-b41d5cb97e80 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:43.396482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-574b4aca-d2f3-46eb-8129-9121e5d16fdb None None] MFA Rules not processed for user `df48869402d04c58b35e046a041bc276`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:43.399383 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-574b4aca-d2f3-46eb-8129-9121e5d16fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:43.426704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024b393-4b1a-410b-91bd-8c0b914fea7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:43.428166 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024b393-4b1a-410b-91bd-8c0b914fea7b service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:43.428685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024b393-4b1a-410b-91bd-8c0b914fea7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:43.429227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024b393-4b1a-410b-91bd-8c0b914fea7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:43.431496 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2024b393-4b1a-410b-91bd-8c0b914fea7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:43.446257 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024b393-4b1a-410b-91bd-8c0b914fea7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:43.447561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024b393-4b1a-410b-91bd-8c0b914fea7b service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:43.463997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 902/1783] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:43.464884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024b393-4b1a-410b-91bd-8c0b914fea7b service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:43.466697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2024b393-4b1a-410b-91bd-8c0b914fea7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:43.508660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:43.577885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 882/1784] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:43.579081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4aca-d2f3-46eb-8129-9121e5d16fdb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:43.589777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-574b4aca-d2f3-46eb-8129-9121e5d16fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:43.651745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024b393-4b1a-410b-91bd-8c0b914fea7b service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:43.659438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:43.661050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:43.661709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:43.661709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] PATH_INFO: `/v3/users/008d38040625431d8dbbb50a87da99ae` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:43.663351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=008d38040625431d8dbbb50a87da99ae)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:43.666493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:43.755447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b4aca-d2f3-46eb-8129-9121e5d16fdb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:43.763366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e46c2-e93b-49fc-994e-959a374de4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:43.764289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e46c2-e93b-49fc-994e-959a374de4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:43.764613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e46c2-e93b-49fc-994e-959a374de4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:43.764962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e46c2-e93b-49fc-994e-959a374de4e2 admin admin] PATH_INFO: `/v3/projects/74ac2d84ea5146cd8f45a58f827fe0cd/users/0df10590fd02440fb385055c90c8258e/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:43.767384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e46c2-e93b-49fc-994e-959a374de4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ac2d84ea5146cd8f45a58f827fe0cd, user_id=0df10590fd02440fb385055c90c8258e, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:43.771031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e46c2-e93b-49fc-994e-959a374de4e2 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:43.784903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008d38040625431d8dbbb50a87da99ae'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:43.786419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008d38040625431d8dbbb50a87da99ae'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:43.789656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008d38040625431d8dbbb50a87da99ae'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:43.800472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 883/1785] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:43 2022] PUT /identity/v3/projects/74ac2d84ea5146cd8f45a58f827fe0cd/users/0df10590fd02440fb385055c90c8258e/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:43.813301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e46c2-e93b-49fc-994e-959a374de4e2 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:43.817067 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008d38040625431d8dbbb50a87da99ae'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:43.819783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-608e46c2-e93b-49fc-994e-959a374de4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:43.832117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008d38040625431d8dbbb50a87da99ae'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:43.835150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:43.881426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 903/1786] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:43 2022] DELETE /identity/v3/users/008d38040625431d8dbbb50a87da99ae => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:43.886271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:43.890938 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:43.984570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e46c2-e93b-49fc-994e-959a374de4e2 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:44.021390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20004060-5808-415a-9a9e-4e72531a85e6 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:44.032731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718af60-400f-460e-8e6a-aad73e584c86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:44.040800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718af60-400f-460e-8e6a-aad73e584c86 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.040800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718af60-400f-460e-8e6a-aad73e584c86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.040800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718af60-400f-460e-8e6a-aad73e584c86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.040800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b718af60-400f-460e-8e6a-aad73e584c86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:44.087301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bc642-6e68-4543-be99-f46781177a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:44.088118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bc642-6e68-4543-be99-f46781177a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.097504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bc642-6e68-4543-be99-f46781177a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.097866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bc642-6e68-4543-be99-f46781177a63 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.098669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bc642-6e68-4543-be99-f46781177a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:44.101019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bc642-6e68-4543-be99-f46781177a63 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:44.153736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 884/1787] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:43 2022] POST /identity/v3/users => generated 301 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:44.156083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00543-287a-4a24-9904-000f0e6f8abc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.156448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00543-287a-4a24-9904-000f0e6f8abc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.156898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c00543-287a-4a24-9904-000f0e6f8abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.199682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718af60-400f-460e-8e6a-aad73e584c86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:44.214134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718af60-400f-460e-8e6a-aad73e584c86 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:44.240355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:44.253688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d7c00543-287a-4a24-9904-000f0e6f8abc None None] MFA Rules not processed for user `0df10590fd02440fb385055c90c8258e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:44.253688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d7c00543-287a-4a24-9904-000f0e6f8abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:44.256659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 904/1788] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:44.258063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718af60-400f-460e-8e6a-aad73e584c86 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:44.283580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718af60-400f-460e-8e6a-aad73e584c86 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:44.293856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386ef3a-c2f8-4978-8202-94a974cf54fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:44.294854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386ef3a-c2f8-4978-8202-94a974cf54fd admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.295829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386ef3a-c2f8-4978-8202-94a974cf54fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.296073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386ef3a-c2f8-4978-8202-94a974cf54fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.297655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386ef3a-c2f8-4978-8202-94a974cf54fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:44.303680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386ef3a-c2f8-4978-8202-94a974cf54fd admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:44.320535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 905/1789] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:44.329670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386ef3a-c2f8-4978-8202-94a974cf54fd admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:44.350253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386ef3a-c2f8-4978-8202-94a974cf54fd admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:44.361082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923011c6-6159-4f50-86fd-0a4b58cd8e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:44.361840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923011c6-6159-4f50-86fd-0a4b58cd8e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.362135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923011c6-6159-4f50-86fd-0a4b58cd8e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.362531 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923011c6-6159-4f50-86fd-0a4b58cd8e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.363733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923011c6-6159-4f50-86fd-0a4b58cd8e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:44.368219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923011c6-6159-4f50-86fd-0a4b58cd8e2f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:44.388253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 906/1790] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:44.390095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923011c6-6159-4f50-86fd-0a4b58cd8e2f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:44.402406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-923011c6-6159-4f50-86fd-0a4b58cd8e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:44.428183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923011c6-6159-4f50-86fd-0a4b58cd8e2f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:44.453628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:44.456462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.457881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.462289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] PATH_INFO: `/v3/users/c47fe6f6ad044e078ac010cf881857fc` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.481579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47fe6f6ad044e078ac010cf881857fc)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:44.491666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:44.528149 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 885/1791] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:44.529048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c00543-287a-4a24-9904-000f0e6f8abc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:44.571762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c00543-287a-4a24-9904-000f0e6f8abc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:44.577152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c5261-d4b6-4189-a184-77da3cfe0cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:44.578080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5261-d4b6-4189-a184-77da3cfe0cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.578424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5261-d4b6-4189-a184-77da3cfe0cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.578678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c5261-d4b6-4189-a184-77da3cfe0cfb admin admin] PATH_INFO: `/v3/projects/f7889c1b5e5f4e32a2238fc1ec8a1d55/users/38cfbb3cac2f45bcacbe32c97c491709/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.606078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c5261-d4b6-4189-a184-77da3cfe0cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7889c1b5e5f4e32a2238fc1ec8a1d55, user_id=38cfbb3cac2f45bcacbe32c97c491709, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:44.609521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c5261-d4b6-4189-a184-77da3cfe0cfb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:44.633534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 886/1792] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:44 2022] PUT /identity/v3/projects/f7889c1b5e5f4e32a2238fc1ec8a1d55/users/38cfbb3cac2f45bcacbe32c97c491709/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:44.634481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c5261-d4b6-4189-a184-77da3cfe0cfb admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:44.643926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fa9c5261-d4b6-4189-a184-77da3cfe0cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:44.656765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47fe6f6ad044e078ac010cf881857fc'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:44.660738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47fe6f6ad044e078ac010cf881857fc'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:44.661955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47fe6f6ad044e078ac010cf881857fc'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:44.681596 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47fe6f6ad044e078ac010cf881857fc'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:44.697579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47fe6f6ad044e078ac010cf881857fc'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:44.699457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:44.733918 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 907/1793] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:44 2022] DELETE /identity/v3/users/c47fe6f6ad044e078ac010cf881857fc => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:44.736344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:44.738820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:44.794709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c5261-d4b6-4189-a184-77da3cfe0cfb admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:44.909223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41198450-b304-40cb-a894-65fe0c97faf1 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:44.927817 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:44.933591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.934373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.934870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] PATH_INFO: `/v3/projects/2ed6de05edbb4c979731cbdd33806661` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.936596 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed6de05edbb4c979731cbdd33806661)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:44.939657 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:44.979043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15039d1a-7f5c-43ec-a34e-d215d875f761 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:44.979782 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15039d1a-7f5c-43ec-a34e-d215d875f761 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:44.980162 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15039d1a-7f5c-43ec-a34e-d215d875f761 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:44.980449 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15039d1a-7f5c-43ec-a34e-d215d875f761 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:44.984563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-15039d1a-7f5c-43ec-a34e-d215d875f761 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:45.047239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed6de05edbb4c979731cbdd33806661', 'request_id': 'req-c7b3aff0-8680-4245-a324-ccc16f1e5a34'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:45.073778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed6de05edbb4c979731cbdd33806661', 'request_id': 'req-c7b3aff0-8680-4245-a324-ccc16f1e5a34'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:45.104978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed6de05edbb4c979731cbdd33806661', 'request_id': 'req-c7b3aff0-8680-4245-a324-ccc16f1e5a34'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:45.116203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:45.157563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] The token cache is being invalidate because project 2ed6de05edbb4c979731cbdd33806661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:45.158298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:45.162870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c7b3aff0-8680-4245-a324-ccc16f1e5a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:45.170984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15039d1a-7f5c-43ec-a34e-d215d875f761 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:45.172448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15039d1a-7f5c-43ec-a34e-d215d875f761 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:45.174272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 908/1794] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:44 2022] DELETE /identity/v3/projects/2ed6de05edbb4c979731cbdd33806661 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:45.179641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd928d-af22-49ce-99af-b75a3cf3e5f9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:45.181973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd928d-af22-49ce-99af-b75a3cf3e5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:45.184295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd928d-af22-49ce-99af-b75a3cf3e5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:45.208528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 887/1795] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:45.209983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde1667-316c-4337-bdcf-2868a22abf23 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:45.210328 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde1667-316c-4337-bdcf-2868a22abf23 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:45.215078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde1667-316c-4337-bdcf-2868a22abf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:45.260093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9fde1667-316c-4337-bdcf-2868a22abf23 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:45.261269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9fde1667-316c-4337-bdcf-2868a22abf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:45.313382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1bdd928d-af22-49ce-99af-b75a3cf3e5f9 None None] MFA Rules not processed for user `38cfbb3cac2f45bcacbe32c97c491709`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:45.321455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1bdd928d-af22-49ce-99af-b75a3cf3e5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:45.487708 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 888/1796] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:45.489490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a227e8-c66d-425e-8743-c58451957a88 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:45.500152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a227e8-c66d-425e-8743-c58451957a88 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:45.500675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a227e8-c66d-425e-8743-c58451957a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:45.530738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:45.556739 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-28a227e8-c66d-425e-8743-c58451957a88 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:45.557317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 909/1797] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:45.562553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd928d-af22-49ce-99af-b75a3cf3e5f9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:45.563780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-28a227e8-c66d-425e-8743-c58451957a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:45.565720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1bdd928d-af22-49ce-99af-b75a3cf3e5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:45.602550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 889/1798] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:45.604090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a227e8-c66d-425e-8743-c58451957a88 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:45.610902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-28a227e8-c66d-425e-8743-c58451957a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:45.644515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd928d-af22-49ce-99af-b75a3cf3e5f9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:45.669370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274e2e9-f986-4cd1-8c5f-743541e5fbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:45.677676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e2e9-f986-4cd1-8c5f-743541e5fbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:45.678004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e2e9-f986-4cd1-8c5f-743541e5fbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:45.678325 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274e2e9-f986-4cd1-8c5f-743541e5fbb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:45.679096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274e2e9-f986-4cd1-8c5f-743541e5fbb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:45.681409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274e2e9-f986-4cd1-8c5f-743541e5fbb9 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:45.787251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 910/1799] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:45 2022] POST /identity/v3/projects => generated 401 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:45.789697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85622b6c-3ddb-4994-b60e-24ed5773043c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:45.790215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85622b6c-3ddb-4994-b60e-24ed5773043c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:45.791624 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85622b6c-3ddb-4994-b60e-24ed5773043c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:45.835156 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-85622b6c-3ddb-4994-b60e-24ed5773043c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:45.837352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-85622b6c-3ddb-4994-b60e-24ed5773043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:45.843175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a227e8-c66d-425e-8743-c58451957a88 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:46.024910 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68caccf-140f-4811-a190-4fe655a2739d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:46.025615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68caccf-140f-4811-a190-4fe655a2739d service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:46.027071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68caccf-140f-4811-a190-4fe655a2739d service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:46.027370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68caccf-140f-4811-a190-4fe655a2739d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:46.074575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 911/1800] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:46.075591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85622b6c-3ddb-4994-b60e-24ed5773043c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:46.099350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85622b6c-3ddb-4994-b60e-24ed5773043c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:46.116802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d665c3d-9072-407b-9e82-63f559536945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:46.118263 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665c3d-9072-407b-9e82-63f559536945 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:46.118635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665c3d-9072-407b-9e82-63f559536945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:46.118979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d665c3d-9072-407b-9e82-63f559536945 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:46.119779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d665c3d-9072-407b-9e82-63f559536945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:46.121878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d665c3d-9072-407b-9e82-63f559536945 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:46.122426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:46.150700 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68caccf-140f-4811-a190-4fe655a2739d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:46.152749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68caccf-140f-4811-a190-4fe655a2739d service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:46.165412 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 912/1801] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:46 2022] POST /identity/v3/users => generated 307 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:46.165412 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d665c3d-9072-407b-9e82-63f559536945 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:46.181114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 890/1802] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:46.183191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68caccf-140f-4811-a190-4fe655a2739d service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:46.192855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d665c3d-9072-407b-9e82-63f559536945 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:46.201508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68caccf-140f-4811-a190-4fe655a2739d service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:46.205581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96babc-f77a-4ab8-9de1-419d2dec39b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:46.206475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96babc-f77a-4ab8-9de1-419d2dec39b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:46.212395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96babc-f77a-4ab8-9de1-419d2dec39b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:46.212395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96babc-f77a-4ab8-9de1-419d2dec39b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:46.212395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96babc-f77a-4ab8-9de1-419d2dec39b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:46.212395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96babc-f77a-4ab8-9de1-419d2dec39b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:46.212395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96babc-f77a-4ab8-9de1-419d2dec39b2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:46.217562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de23021-2c72-4147-83b5-809c6e6b4ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:46.218664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de23021-2c72-4147-83b5-809c6e6b4ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:46.219636 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de23021-2c72-4147-83b5-809c6e6b4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:46.223463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de23021-2c72-4147-83b5-809c6e6b4ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:46.227476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de23021-2c72-4147-83b5-809c6e6b4ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:46.237232 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de23021-2c72-4147-83b5-809c6e6b4ad1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:46.262556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 913/1803] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:46.268964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96babc-f77a-4ab8-9de1-419d2dec39b2 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:46.278626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 891/1804] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:46.283055 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de23021-2c72-4147-83b5-809c6e6b4ad1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:46.314334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96babc-f77a-4ab8-9de1-419d2dec39b2 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:46.330999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de23021-2c72-4147-83b5-809c6e6b4ad1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:46.337128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8896b-e390-47d4-8f2c-c4979bf705db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:46.341056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8896b-e390-47d4-8f2c-c4979bf705db admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:46.341894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8896b-e390-47d4-8f2c-c4979bf705db admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:46.342214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8896b-e390-47d4-8f2c-c4979bf705db admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:46.345828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8896b-e390-47d4-8f2c-c4979bf705db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:46.354458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d68c5c-02d5-44a9-bd86-20b2c83cfaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:46.357948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8896b-e390-47d4-8f2c-c4979bf705db admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:46.358239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d68c5c-02d5-44a9-bd86-20b2c83cfaa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:46.358543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d68c5c-02d5-44a9-bd86-20b2c83cfaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:46.360955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d68c5c-02d5-44a9-bd86-20b2c83cfaa7 admin admin] PATH_INFO: `/v3/projects/ba100dbd74f7494e863e4921c4a86a80/users/e13945df24674055aea61dd8a75292bd/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:46.408485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d68c5c-02d5-44a9-bd86-20b2c83cfaa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba100dbd74f7494e863e4921c4a86a80, user_id=e13945df24674055aea61dd8a75292bd, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:46.411965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d68c5c-02d5-44a9-bd86-20b2c83cfaa7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:46.437684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 914/1805] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:46 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:46.437684 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8896b-e390-47d4-8f2c-c4979bf705db admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:46.442130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8bc8896b-e390-47d4-8f2c-c4979bf705db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:46.448857 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 892/1806] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:46 2022] PUT /identity/v3/projects/ba100dbd74f7494e863e4921c4a86a80/users/e13945df24674055aea61dd8a75292bd/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:46.450462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d68c5c-02d5-44a9-bd86-20b2c83cfaa7 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:46.586600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d68c5c-02d5-44a9-bd86-20b2c83cfaa7 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:46.598265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8896b-e390-47d4-8f2c-c4979bf705db admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:46.607838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aceba2-56c7-4472-9ef6-1ca1b2a9d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:46.609045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aceba2-56c7-4472-9ef6-1ca1b2a9d0ed admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:46.609271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aceba2-56c7-4472-9ef6-1ca1b2a9d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:46.609742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aceba2-56c7-4472-9ef6-1ca1b2a9d0ed admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:46.610741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aceba2-56c7-4472-9ef6-1ca1b2a9d0ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:46.613495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aceba2-56c7-4472-9ef6-1ca1b2a9d0ed admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:46.632799 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:46.635305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:46.636455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:46.636956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] PATH_INFO: `/v3/users/f2b13142a24b4072bef484457b81db0d` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:46.639350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b13142a24b4072bef484457b81db0d)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:46.643047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:46.659928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 893/1807] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:46 2022] POST /identity/v3/users => generated 281 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:46.667450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aceba2-56c7-4472-9ef6-1ca1b2a9d0ed admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:46.698387 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aceba2-56c7-4472-9ef6-1ca1b2a9d0ed admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:46.720206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e8c58-bc38-48e7-bda0-f60afaba7c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:46.721357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e8c58-bc38-48e7-bda0-f60afaba7c5b admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:46.721655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e8c58-bc38-48e7-bda0-f60afaba7c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:46.721939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e8c58-bc38-48e7-bda0-f60afaba7c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:46.731887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e8c58-bc38-48e7-bda0-f60afaba7c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:46.738637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e8c58-bc38-48e7-bda0-f60afaba7c5b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:46.740437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:46.770643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 894/1808] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:46.770643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5349c8-eb4a-441e-a136-02b2aabf6a5f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:46.770643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5349c8-eb4a-441e-a136-02b2aabf6a5f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:46.770643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5349c8-eb4a-441e-a136-02b2aabf6a5f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:46.776977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 895/1809] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:13:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:46.788008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b13142a24b4072bef484457b81db0d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:46.790518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b13142a24b4072bef484457b81db0d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:46.792801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5349c8-eb4a-441e-a136-02b2aabf6a5f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:46.793898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b13142a24b4072bef484457b81db0d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:46.798369 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7f5349c8-eb4a-441e-a136-02b2aabf6a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:46.822705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b13142a24b4072bef484457b81db0d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:46.825835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5349c8-eb4a-441e-a136-02b2aabf6a5f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:46.831431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:46.832289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:46.832583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:46.832999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] PATH_INFO: `/v3/projects/a7b91db66c6c4c878815e1aac3bb0d59` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:46.836478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b91db66c6c4c878815e1aac3bb0d59)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:46.840125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:46.844423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b13142a24b4072bef484457b81db0d'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:46.888009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 915/1810] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:46 2022] DELETE /identity/v3/users/f2b13142a24b4072bef484457b81db0d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:46.889421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:46.894364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:46.984770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b91db66c6c4c878815e1aac3bb0d59', 'request_id': 'req-a2c27fbb-8429-4d1d-a71a-58bc01984783'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:46.993563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b91db66c6c4c878815e1aac3bb0d59', 'request_id': 'req-a2c27fbb-8429-4d1d-a71a-58bc01984783'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:47.019919 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da839eaf-6be6-4349-a0fc-b810d5678c10 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:47.020831 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b91db66c6c4c878815e1aac3bb0d59', 'request_id': 'req-a2c27fbb-8429-4d1d-a71a-58bc01984783'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:47.049680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] The token cache is being invalidate because project a7b91db66c6c4c878815e1aac3bb0d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:47.049970 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:47.050750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a2c27fbb-8429-4d1d-a71a-58bc01984783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:47.053063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 896/1811] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:46 2022] DELETE /identity/v3/projects/a7b91db66c6c4c878815e1aac3bb0d59 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:47.055695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554eec-9956-419b-8ddd-212ee890e637 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.056153 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554eec-9956-419b-8ddd-212ee890e637 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.056437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64554eec-9956-419b-8ddd-212ee890e637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.075904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:47.087976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-64554eec-9956-419b-8ddd-212ee890e637 None None] MFA Rules not processed for user `79023e778baa45888e6ef870499e5ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:47.092027 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-64554eec-9956-419b-8ddd-212ee890e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:47.166842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8777c7-ae9f-4691-9826-40ac86899e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:47.167559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8777c7-ae9f-4691-9826-40ac86899e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.167833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8777c7-ae9f-4691-9826-40ac86899e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.168110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8777c7-ae9f-4691-9826-40ac86899e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.172749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8777c7-ae9f-4691-9826-40ac86899e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:47.174526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8777c7-ae9f-4691-9826-40ac86899e70 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:47.183676 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 897/1812] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:47.184544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64554eec-9956-419b-8ddd-212ee890e637 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:47.186574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-64554eec-9956-419b-8ddd-212ee890e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:47.206759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 916/1813] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:47.206759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc86ff5-fd0a-463b-b78e-8cf9aaad8b80 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.206759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc86ff5-fd0a-463b-b78e-8cf9aaad8b80 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.206759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc86ff5-fd0a-463b-b78e-8cf9aaad8b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.223301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64554eec-9956-419b-8ddd-212ee890e637 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:47.230935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab9bc7-7e5e-45b0-a9b4-9d91f6954cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:47.232028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9bc7-7e5e-45b0-a9b4-9d91f6954cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.232320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9bc7-7e5e-45b0-a9b4-9d91f6954cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.232596 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab9bc7-7e5e-45b0-a9b4-9d91f6954cb0 admin admin] PATH_INFO: `/v3/projects/ba100dbd74f7494e863e4921c4a86a80/users/e13945df24674055aea61dd8a75292bd/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.234720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab9bc7-7e5e-45b0-a9b4-9d91f6954cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba100dbd74f7494e863e4921c4a86a80, user_id=e13945df24674055aea61dd8a75292bd, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:47.238264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab9bc7-7e5e-45b0-a9b4-9d91f6954cb0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:47.255291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 898/1814] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:47 2022] PUT /identity/v3/projects/ba100dbd74f7494e863e4921c4a86a80/users/e13945df24674055aea61dd8a75292bd/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:47.256709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee90030-bc72-47b9-a55d-a9405be1600d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.258055 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee90030-bc72-47b9-a55d-a9405be1600d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.258368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee90030-bc72-47b9-a55d-a9405be1600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.261930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-abc86ff5-fd0a-463b-b78e-8cf9aaad8b80 None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:47.264695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-abc86ff5-fd0a-463b-b78e-8cf9aaad8b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:47.306181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cee90030-bc72-47b9-a55d-a9405be1600d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:47.309150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cee90030-bc72-47b9-a55d-a9405be1600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:47.372078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:47.402304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 917/1815] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:13:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:47.403762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ada43-23af-4731-9361-16f964848847 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.403762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ada43-23af-4731-9361-16f964848847 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.404093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ada43-23af-4731-9361-16f964848847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.428051 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 899/1816] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:47.430116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee90030-bc72-47b9-a55d-a9405be1600d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:47.432791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cee90030-bc72-47b9-a55d-a9405be1600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:47.448829 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee90030-bc72-47b9-a55d-a9405be1600d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:47.449633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-141ada43-23af-4731-9361-16f964848847 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:47.452542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-141ada43-23af-4731-9361-16f964848847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:47.474424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9445f-44fa-4cf0-843b-c567f9d71679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:47.475441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9445f-44fa-4cf0-843b-c567f9d71679 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.475871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9445f-44fa-4cf0-843b-c567f9d71679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.476884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9445f-44fa-4cf0-843b-c567f9d71679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.477820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9445f-44fa-4cf0-843b-c567f9d71679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:47.482825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a9445f-44fa-4cf0-843b-c567f9d71679 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:47.506008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 918/1817] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:47.506477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 900/1818] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:47.507784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9445f-44fa-4cf0-843b-c567f9d71679 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:47.511520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269dd05-055b-41d1-ba88-095016c0f095 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.511935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269dd05-055b-41d1-ba88-095016c0f095 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.512449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269dd05-055b-41d1-ba88-095016c0f095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.512646 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-68a9445f-44fa-4cf0-843b-c567f9d71679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:47.620851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1269dd05-055b-41d1-ba88-095016c0f095 None None] MFA Rules not processed for user `e13945df24674055aea61dd8a75292bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:47.622418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1269dd05-055b-41d1-ba88-095016c0f095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:47.680948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a9445f-44fa-4cf0-843b-c567f9d71679 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:47.687038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdf5e9-d068-4a0f-830b-19b709fc91a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:47.688148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdf5e9-d068-4a0f-830b-19b709fc91a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.688728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdf5e9-d068-4a0f-830b-19b709fc91a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.689411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdf5e9-d068-4a0f-830b-19b709fc91a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.703473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdf5e9-d068-4a0f-830b-19b709fc91a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:47.705714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdf5e9-d068-4a0f-830b-19b709fc91a1 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:47.721946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 901/1819] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:47.723212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdf5e9-d068-4a0f-830b-19b709fc91a1 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:47.738905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdf5e9-d068-4a0f-830b-19b709fc91a1 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:47.745244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73db13e-431b-45af-8477-9466344e8654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:47.747038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73db13e-431b-45af-8477-9466344e8654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.747554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73db13e-431b-45af-8477-9466344e8654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.748032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73db13e-431b-45af-8477-9466344e8654 admin admin] PATH_INFO: `/v3/projects/a9e44d0578564802afb26cebac86c19d/users/fab3c31954c5438eba1c769370d1d26a/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.779490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73db13e-431b-45af-8477-9466344e8654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e44d0578564802afb26cebac86c19d, user_id=fab3c31954c5438eba1c769370d1d26a, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:47.785419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73db13e-431b-45af-8477-9466344e8654 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:47.794604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 919/1820] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:47 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:47.796886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21236-1eef-4db0-ab20-ba19c8cec498 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.797223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21236-1eef-4db0-ab20-ba19c8cec498 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.797518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c21236-1eef-4db0-ab20-ba19c8cec498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.828520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 902/1821] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:47 2022] PUT /identity/v3/projects/a9e44d0578564802afb26cebac86c19d/users/fab3c31954c5438eba1c769370d1d26a/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:47.830432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73db13e-431b-45af-8477-9466344e8654 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:47.832078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a5c21236-1eef-4db0-ab20-ba19c8cec498 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:47.834469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a5c21236-1eef-4db0-ab20-ba19c8cec498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:47.836585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f73db13e-431b-45af-8477-9466344e8654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:47.852547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:47.967141 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73db13e-431b-45af-8477-9466344e8654 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:47.979344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6d0ff-82f8-4db1-baf7-d3592a843e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:47.980278 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6d0ff-82f8-4db1-baf7-d3592a843e52 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.980793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6d0ff-82f8-4db1-baf7-d3592a843e52 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.981209 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6d0ff-82f8-4db1-baf7-d3592a843e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.990001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 920/1822] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:47.990001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a6f3-d670-4574-adb7-b8e1cec79fe2 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:47.990001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a6f3-d670-4574-adb7-b8e1cec79fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:47.990433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a6f3-d670-4574-adb7-b8e1cec79fe2 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:47.993305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 921/1823] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:13:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:47.994343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4a6f3-d670-4574-adb7-b8e1cec79fe2 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:47.996299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-23d4a6f3-d670-4574-adb7-b8e1cec79fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:47.996761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6d0ff-82f8-4db1-baf7-d3592a843e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:47.998704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6d0ff-82f8-4db1-baf7-d3592a843e52 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:48.026110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 903/1824] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:48.032237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279325-1aae-4130-bbe0-0ac7972c97f3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.033616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279325-1aae-4130-bbe0-0ac7972c97f3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.034698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22279325-1aae-4130-bbe0-0ac7972c97f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.097627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-22279325-1aae-4130-bbe0-0ac7972c97f3 None None] MFA Rules not processed for user `fab3c31954c5438eba1c769370d1d26a`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:48.103349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-22279325-1aae-4130-bbe0-0ac7972c97f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:48.115163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4a6f3-d670-4574-adb7-b8e1cec79fe2 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:48.125274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc1157-425f-47e4-a1d2-ae131b669398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:48.126213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1157-425f-47e4-a1d2-ae131b669398 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.126791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1157-425f-47e4-a1d2-ae131b669398 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.127251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc1157-425f-47e4-a1d2-ae131b669398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.152455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:48.219860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 904/1825] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:48.240217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22279325-1aae-4130-bbe0-0ac7972c97f3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:48.242914 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc1157-425f-47e4-a1d2-ae131b669398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:48.245608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc1157-425f-47e4-a1d2-ae131b669398 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:48.271728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 922/1826] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:48.276879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710a2a2-7973-4c38-8c53-3eb15416c544 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.277110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22279325-1aae-4130-bbe0-0ac7972c97f3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:48.278960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710a2a2-7973-4c38-8c53-3eb15416c544 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.279758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710a2a2-7973-4c38-8c53-3eb15416c544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.290921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9a85e-7118-425e-8c19-1ec639d9d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:48.294054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9a85e-7118-425e-8c19-1ec639d9d5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.294960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9a85e-7118-425e-8c19-1ec639d9d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.296509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9a85e-7118-425e-8c19-1ec639d9d5e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.298466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9a85e-7118-425e-8c19-1ec639d9d5e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:48.299299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9a85e-7118-425e-8c19-1ec639d9d5e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:48.308218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9a85e-7118-425e-8c19-1ec639d9d5e5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:48.340060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-9710a2a2-7973-4c38-8c53-3eb15416c544 None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:48.341504 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9710a2a2-7973-4c38-8c53-3eb15416c544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:48.342776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 905/1827] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:48.344543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9a85e-7118-425e-8c19-1ec639d9d5e5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:48.350345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a9c9a85e-7118-425e-8c19-1ec639d9d5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:48.388386 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9a85e-7118-425e-8c19-1ec639d9d5e5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:48.396304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386784a-a5a7-4bc1-b8f2-45864e6d0fb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:48.396552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 923/1828] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:48.397004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386784a-a5a7-4bc1-b8f2-45864e6d0fb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.397378 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386784a-a5a7-4bc1-b8f2-45864e6d0fb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.397556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386784a-a5a7-4bc1-b8f2-45864e6d0fb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.398041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710a2a2-7973-4c38-8c53-3eb15416c544 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:48.403325 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9710a2a2-7973-4c38-8c53-3eb15416c544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:48.411001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386784a-a5a7-4bc1-b8f2-45864e6d0fb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:48.412656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386784a-a5a7-4bc1-b8f2-45864e6d0fb8 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:48.428549 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710a2a2-7973-4c38-8c53-3eb15416c544 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:48.436376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:48.437773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.437933 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 906/1829] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:48.438405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.438796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] PATH_INFO: `/v3/projects/c9d0ba4d5ab242b59edc1ae0dd823d63` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.439014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386784a-a5a7-4bc1-b8f2-45864e6d0fb8 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:48.440575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d0ba4d5ab242b59edc1ae0dd823d63)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:48.443081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:48.460253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386784a-a5a7-4bc1-b8f2-45864e6d0fb8 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:48.468737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12b605-5592-48c4-bb31-4a3c9aec0757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:48.469424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12b605-5592-48c4-bb31-4a3c9aec0757 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.469704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12b605-5592-48c4-bb31-4a3c9aec0757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.469982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12b605-5592-48c4-bb31-4a3c9aec0757 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.471655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12b605-5592-48c4-bb31-4a3c9aec0757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:48.474189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12b605-5592-48c4-bb31-4a3c9aec0757 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:48.523563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 907/1830] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:48 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:48.524669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12b605-5592-48c4-bb31-4a3c9aec0757 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:48.542191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d0ba4d5ab242b59edc1ae0dd823d63', 'request_id': 'req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:48.555536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d0ba4d5ab242b59edc1ae0dd823d63', 'request_id': 'req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:48.564310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d0ba4d5ab242b59edc1ae0dd823d63', 'request_id': 'req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:48.586645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] The token cache is being invalidate because project c9d0ba4d5ab242b59edc1ae0dd823d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:48.587137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:48.588369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:48.590875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:48.597652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 924/1831] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:48 2022] DELETE /identity/v3/projects/c9d0ba4d5ab242b59edc1ae0dd823d63 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:48.600076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:48.604434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:48.631560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12b605-5592-48c4-bb31-4a3c9aec0757 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:48.636874 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982c4b5-2211-4d3c-ba5a-7465bfd3fd44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:48.637356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982c4b5-2211-4d3c-ba5a-7465bfd3fd44 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.637627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982c4b5-2211-4d3c-ba5a-7465bfd3fd44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.637900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982c4b5-2211-4d3c-ba5a-7465bfd3fd44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.639902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0982c4b5-2211-4d3c-ba5a-7465bfd3fd44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:48.708287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982c4b5-2211-4d3c-ba5a-7465bfd3fd44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:48.711014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982c4b5-2211-4d3c-ba5a-7465bfd3fd44 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:48.721002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 908/1832] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:48.721947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982c4b5-2211-4d3c-ba5a-7465bfd3fd44 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:48.723425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0982c4b5-2211-4d3c-ba5a-7465bfd3fd44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:48.756186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c6479-eb13-4e81-b4b7-c46d3727a9ca admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:48.795475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:48.812059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982c4b5-2211-4d3c-ba5a-7465bfd3fd44 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:48.818142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:48.819460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.820727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.821013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] PATH_INFO: `/v3/users/fab3c31954c5438eba1c769370d1d26a` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.822446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab3c31954c5438eba1c769370d1d26a)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:48.824398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:48.905491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfb436-858f-4101-a0f9-5e3db74cb270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:48.907296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfb436-858f-4101-a0f9-5e3db74cb270 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.907615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfb436-858f-4101-a0f9-5e3db74cb270 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.907861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfb436-858f-4101-a0f9-5e3db74cb270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.908051 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab3c31954c5438eba1c769370d1d26a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:48.910035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f0dfb436-858f-4101-a0f9-5e3db74cb270 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:48.911365 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab3c31954c5438eba1c769370d1d26a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:48.912042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab3c31954c5438eba1c769370d1d26a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:48.927011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfb436-858f-4101-a0f9-5e3db74cb270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:48.928212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab3c31954c5438eba1c769370d1d26a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:48.928902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfb436-858f-4101-a0f9-5e3db74cb270 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:48.948284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 925/1833] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:48.949163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfb436-858f-4101-a0f9-5e3db74cb270 service nova] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:48.951571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f0dfb436-858f-4101-a0f9-5e3db74cb270 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:48.974488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfb436-858f-4101-a0f9-5e3db74cb270 service nova] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:48.982170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9c806-e0db-4ca7-83fa-b7adf6027563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:48.983810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9c806-e0db-4ca7-83fa-b7adf6027563 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:48.984105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9c806-e0db-4ca7-83fa-b7adf6027563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:48.984636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9c806-e0db-4ca7-83fa-b7adf6027563 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:48.985730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9c806-e0db-4ca7-83fa-b7adf6027563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:48.988360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab3c31954c5438eba1c769370d1d26a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:48.989740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9c806-e0db-4ca7-83fa-b7adf6027563 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:49.022227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 909/1834] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:48 2022] DELETE /identity/v3/users/fab3c31954c5438eba1c769370d1d26a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:49.024926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:49.026743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:49.039783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 926/1835] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:48 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:49.040010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:49.046643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef2780-9af6-4a29-b25c-f3f45273ded2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:49.047307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef2780-9af6-4a29-b25c-f3f45273ded2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:49.048001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef2780-9af6-4a29-b25c-f3f45273ded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:49.117167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-11ef2780-9af6-4a29-b25c-f3f45273ded2 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:49.118980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-11ef2780-9af6-4a29-b25c-f3f45273ded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:49.232290 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73208899-f55d-4417-8c8c-955241730b69 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:49.240737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:49.241933 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:49.242424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:49.242843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] PATH_INFO: `/v3/users/df48869402d04c58b35e046a041bc276` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:49.244545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df48869402d04c58b35e046a041bc276)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:49.269926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:49.273693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 927/1836] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:49.275149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef2780-9af6-4a29-b25c-f3f45273ded2 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:49.282954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-11ef2780-9af6-4a29-b25c-f3f45273ded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:49.303724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef2780-9af6-4a29-b25c-f3f45273ded2 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:49.313026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f84c5-cbe2-4371-ad8c-c032d68ee3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:49.314270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f84c5-cbe2-4371-ad8c-c032d68ee3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:49.314565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f84c5-cbe2-4371-ad8c-c032d68ee3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:49.315006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f84c5-cbe2-4371-ad8c-c032d68ee3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:49.315909 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f84c5-cbe2-4371-ad8c-c032d68ee3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:49.317776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f84c5-cbe2-4371-ad8c-c032d68ee3b1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:49.368249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 928/1837] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:49.371157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f84c5-cbe2-4371-ad8c-c032d68ee3b1 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:49.375397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fa0f84c5-cbe2-4371-ad8c-c032d68ee3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:49.419685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f84c5-cbe2-4371-ad8c-c032d68ee3b1 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:49.422499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df48869402d04c58b35e046a041bc276'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.423180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df48869402d04c58b35e046a041bc276'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.424116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df48869402d04c58b35e046a041bc276'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.432151 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:49.433040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:49.433328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:49.433609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] PATH_INFO: `/v3/projects/05f3b006e92148c5aca409f5a00a82d5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:49.440852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f3b006e92148c5aca409f5a00a82d5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:49.443088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:49.445701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df48869402d04c58b35e046a041bc276'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.475784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df48869402d04c58b35e046a041bc276'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.499493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 910/1838] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:49 2022] DELETE /identity/v3/users/df48869402d04c58b35e046a041bc276 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:49.503663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:49.518400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:49.529438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f3b006e92148c5aca409f5a00a82d5', 'request_id': 'req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.537356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f3b006e92148c5aca409f5a00a82d5', 'request_id': 'req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.544144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f3b006e92148c5aca409f5a00a82d5', 'request_id': 'req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.561255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] The token cache is being invalidate because project 05f3b006e92148c5aca409f5a00a82d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:49.561443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.562218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.566518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 929/1839] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:49 2022] DELETE /identity/v3/projects/05f3b006e92148c5aca409f5a00a82d5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:49.567758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:49.569343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:49.583612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:49.614534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6b624-e830-48aa-9f68-7a9c7933c2a7 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:49.675963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:49.677040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e11f-c0cc-43f6-ad4f-8b96e5357623 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:49.683759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e2c7e-55d6-4560-806b-caf7ed62564d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:49.684477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2c7e-55d6-4560-806b-caf7ed62564d admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:49.684874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2c7e-55d6-4560-806b-caf7ed62564d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:49.685225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2c7e-55d6-4560-806b-caf7ed62564d admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:49.686023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e2c7e-55d6-4560-806b-caf7ed62564d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:49.687959 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e2c7e-55d6-4560-806b-caf7ed62564d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:49.689526 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b3924-0745-4946-8702-fe9f2b0a9bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:49.690137 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b3924-0745-4946-8702-fe9f2b0a9bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:49.690671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b3924-0745-4946-8702-fe9f2b0a9bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:49.690778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b3924-0745-4946-8702-fe9f2b0a9bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:49.692973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-832b3924-0745-4946-8702-fe9f2b0a9bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:49.699774 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 930/1840] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:49.700786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e2c7e-55d6-4560-806b-caf7ed62564d admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:49.702544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7d6e2c7e-55d6-4560-806b-caf7ed62564d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:49.707236 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b3924-0745-4946-8702-fe9f2b0a9bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:49.708791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b3924-0745-4946-8702-fe9f2b0a9bc4 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:49.717045 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e2c7e-55d6-4560-806b-caf7ed62564d admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:49.720506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 911/1841] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:49.721180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b3924-0745-4946-8702-fe9f2b0a9bc4 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:49.722280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:49.723693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:49.724044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:49.724775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] PATH_INFO: `/v3/users/0df10590fd02440fb385055c90c8258e` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:49.727129 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df10590fd02440fb385055c90c8258e)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:49.729574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:49.732361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b3924-0745-4946-8702-fe9f2b0a9bc4 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:49.738397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39844b2-4719-47f0-8034-55d168017b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:49.739349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39844b2-4719-47f0-8034-55d168017b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:49.739634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39844b2-4719-47f0-8034-55d168017b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:49.739914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39844b2-4719-47f0-8034-55d168017b41 admin admin] PATH_INFO: `/v3/projects/5f3e6a25d7334bda93a801fd187c5253/users/d04e85d2bf0a4299a76ed11e003b55fa/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:49.762309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39844b2-4719-47f0-8034-55d168017b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f3e6a25d7334bda93a801fd187c5253, user_id=d04e85d2bf0a4299a76ed11e003b55fa, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:49.765356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39844b2-4719-47f0-8034-55d168017b41 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:49.794366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 912/1842] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:49 2022] PUT /identity/v3/projects/5f3e6a25d7334bda93a801fd187c5253/users/d04e85d2bf0a4299a76ed11e003b55fa/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:49.806887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914880f7-fe34-4030-b28c-32c1cb752d2e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:49.807341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914880f7-fe34-4030-b28c-32c1cb752d2e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:49.807444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914880f7-fe34-4030-b28c-32c1cb752d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:49.818326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df10590fd02440fb385055c90c8258e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.820806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df10590fd02440fb385055c90c8258e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.823264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df10590fd02440fb385055c90c8258e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.841215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df10590fd02440fb385055c90c8258e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.851842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-914880f7-fe34-4030-b28c-32c1cb752d2e None None] MFA Rules not processed for user `d04e85d2bf0a4299a76ed11e003b55fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:49.852486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df10590fd02440fb385055c90c8258e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:49.857339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-914880f7-fe34-4030-b28c-32c1cb752d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:49.888570 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 931/1843] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:49 2022] DELETE /identity/v3/users/0df10590fd02440fb385055c90c8258e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:49.947474 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 913/1844] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:49.951790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:49.953795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:50.041643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae9b1a-d52d-4791-a348-53a56843ab94 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:50.042860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914880f7-fe34-4030-b28c-32c1cb752d2e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:50.044313 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-914880f7-fe34-4030-b28c-32c1cb752d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:50.047283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe5ca6-b13d-45ea-9b51-29a53fef5c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:50.048033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe5ca6-b13d-45ea-9b51-29a53fef5c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.048319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe5ca6-b13d-45ea-9b51-29a53fef5c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.050214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe5ca6-b13d-45ea-9b51-29a53fef5c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.051029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe5ca6-b13d-45ea-9b51-29a53fef5c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:50.054774 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe5ca6-b13d-45ea-9b51-29a53fef5c68 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:50.098565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:50.116331 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 932/1845] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:49 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:50.118516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe5ca6-b13d-45ea-9b51-29a53fef5c68 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:50.168087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914880f7-fe34-4030-b28c-32c1cb752d2e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:50.212352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe5ca6-b13d-45ea-9b51-29a53fef5c68 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:50.224025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5970b-8668-495b-8f6c-a5eb987f12c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:50.224961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5970b-8668-495b-8f6c-a5eb987f12c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.225258 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5970b-8668-495b-8f6c-a5eb987f12c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.225540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5970b-8668-495b-8f6c-a5eb987f12c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.226439 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5970b-8668-495b-8f6c-a5eb987f12c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:50.228420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5970b-8668-495b-8f6c-a5eb987f12c8 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:50.271068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 933/1846] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:50 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:13:50.271846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:50.273391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5970b-8668-495b-8f6c-a5eb987f12c8 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:50.290340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:50.291550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.291842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.293224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] PATH_INFO: `/v3/projects/7ff29930e36643cda5caa063ff517937` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.295168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff29930e36643cda5caa063ff517937)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:50.297720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:50.301718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5970b-8668-495b-8f6c-a5eb987f12c8 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:50.321714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f715ebb-a7dc-4a59-a18d-823e8b9ec7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:50.322739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f715ebb-a7dc-4a59-a18d-823e8b9ec7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.322929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f715ebb-a7dc-4a59-a18d-823e8b9ec7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.323324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f715ebb-a7dc-4a59-a18d-823e8b9ec7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.326018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f715ebb-a7dc-4a59-a18d-823e8b9ec7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:50.330635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f715ebb-a7dc-4a59-a18d-823e8b9ec7ca admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:50.364999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 934/1847] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:50.366212 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f715ebb-a7dc-4a59-a18d-823e8b9ec7ca admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:50.370276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2f715ebb-a7dc-4a59-a18d-823e8b9ec7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:50.387554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f715ebb-a7dc-4a59-a18d-823e8b9ec7ca admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:50.394887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff29930e36643cda5caa063ff517937', 'request_id': 'req-7e144f1e-22e7-470c-af65-88f16c5e6f9c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.404081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff29930e36643cda5caa063ff517937', 'request_id': 'req-7e144f1e-22e7-470c-af65-88f16c5e6f9c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.417279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff29930e36643cda5caa063ff517937', 'request_id': 'req-7e144f1e-22e7-470c-af65-88f16c5e6f9c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.431641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] The token cache is being invalidate because project 7ff29930e36643cda5caa063ff517937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:50.432057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.432770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.438056 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 914/1848] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:50 2022] DELETE /identity/v3/projects/7ff29930e36643cda5caa063ff517937 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:50.439372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:50.440312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:50.462221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:50.463010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.463301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.463585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] PATH_INFO: `/v3/projects/a9e44d0578564802afb26cebac86c19d` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.471547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e44d0578564802afb26cebac86c19d)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:50.473745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:50.531877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e144f1e-22e7-470c-af65-88f16c5e6f9c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:50.559929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e44d0578564802afb26cebac86c19d', 'request_id': 'req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.567936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e44d0578564802afb26cebac86c19d', 'request_id': 'req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.575920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e44d0578564802afb26cebac86c19d', 'request_id': 'req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.597245 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] The token cache is being invalidate because project a9e44d0578564802afb26cebac86c19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:50.597537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.599673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.607631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 935/1849] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:50 2022] DELETE /identity/v3/projects/a9e44d0578564802afb26cebac86c19d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:50.609269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:50.612429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:50.616152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3d339-2680-48aa-ad82-3d7148b64af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:50.618087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d339-2680-48aa-ad82-3d7148b64af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.618400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d339-2680-48aa-ad82-3d7148b64af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.618680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d339-2680-48aa-ad82-3d7148b64af0 admin admin] PATH_INFO: `/v3/projects/1b36f322ee9e4a248ffeb7afe577912e/users/b7223ca6d33f444ea8201df1e95dff4b/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.639297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebb579-6bea-46b0-b504-a9d3e91ca5b3 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:50.648473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:50.649760 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.650171 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.651058 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] PATH_INFO: `/v3/projects/74ac2d84ea5146cd8f45a58f827fe0cd` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.652688 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ac2d84ea5146cd8f45a58f827fe0cd)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:50.655310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:50.657618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:50.662309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3d339-2680-48aa-ad82-3d7148b64af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b36f322ee9e4a248ffeb7afe577912e, user_id=b7223ca6d33f444ea8201df1e95dff4b, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:50.668015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3d339-2680-48aa-ad82-3d7148b64af0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:50.727434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ac2d84ea5146cd8f45a58f827fe0cd', 'request_id': 'req-16157a46-3949-4e5c-9a68-144afb9fa0e6'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.730095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 915/1850] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:50 2022] PUT /identity/v3/projects/1b36f322ee9e4a248ffeb7afe577912e/users/b7223ca6d33f444ea8201df1e95dff4b/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:50.730748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75726cb1-f35f-4c55-8eed-7e7c619484c0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.731045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75726cb1-f35f-4c55-8eed-7e7c619484c0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.731325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75726cb1-f35f-4c55-8eed-7e7c619484c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.737685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ac2d84ea5146cd8f45a58f827fe0cd', 'request_id': 'req-16157a46-3949-4e5c-9a68-144afb9fa0e6'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.748889 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ac2d84ea5146cd8f45a58f827fe0cd', 'request_id': 'req-16157a46-3949-4e5c-9a68-144afb9fa0e6'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.754577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-75726cb1-f35f-4c55-8eed-7e7c619484c0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:50.756187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-75726cb1-f35f-4c55-8eed-7e7c619484c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:50.767327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] The token cache is being invalidate because project 74ac2d84ea5146cd8f45a58f827fe0cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:50.767736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.768528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-16157a46-3949-4e5c-9a68-144afb9fa0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:50.771467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 936/1851] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:50 2022] DELETE /identity/v3/projects/74ac2d84ea5146cd8f45a58f827fe0cd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:50.773587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba43e-48ad-4849-843b-d076e84cdb14 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.773955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba43e-48ad-4849-843b-d076e84cdb14 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.775201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ba43e-48ad-4849-843b-d076e84cdb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.782875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:50.799274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-af6ba43e-48ad-4849-843b-d076e84cdb14 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:50.800583 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-af6ba43e-48ad-4849-843b-d076e84cdb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:50.855238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 916/1852] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:50.864389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75726cb1-f35f-4c55-8eed-7e7c619484c0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:50.865644 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-75726cb1-f35f-4c55-8eed-7e7c619484c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:50.883166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75726cb1-f35f-4c55-8eed-7e7c619484c0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:50.888578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf7e03-c8cd-4b87-8d1a-fa033fedd48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:50.889266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf7e03-c8cd-4b87-8d1a-fa033fedd48d admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.889550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf7e03-c8cd-4b87-8d1a-fa033fedd48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.889824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf7e03-c8cd-4b87-8d1a-fa033fedd48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.890590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf7e03-c8cd-4b87-8d1a-fa033fedd48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:50.892206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf7e03-c8cd-4b87-8d1a-fa033fedd48d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:50.910267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 937/1853] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:50.910451 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 917/1854] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:50.910530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7e0e7-9d57-486b-ae86-e406b8717c26 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.910626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502be63-2081-41d0-9c90-79a09ccd4f85 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.910712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7e0e7-9d57-486b-ae86-e406b8717c26 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.910793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502be63-2081-41d0-9c90-79a09ccd4f85 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.910872 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7e0e7-9d57-486b-ae86-e406b8717c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.910951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502be63-2081-41d0-9c90-79a09ccd4f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.933177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7502be63-2081-41d0-9c90-79a09ccd4f85 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:50.934535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7502be63-2081-41d0-9c90-79a09ccd4f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:50.935292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1ce7e0e7-9d57-486b-ae86-e406b8717c26 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:50.936493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1ce7e0e7-9d57-486b-ae86-e406b8717c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:50.944198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 918/1855] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:50.946332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 938/1856] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:50.946507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502be63-2081-41d0-9c90-79a09ccd4f85 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:50.947303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02432644-29e4-45a7-abd5-c01e05411fcd None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.947663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02432644-29e4-45a7-abd5-c01e05411fcd None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.948270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02432644-29e4-45a7-abd5-c01e05411fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.963043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502be63-2081-41d0-9c90-79a09ccd4f85 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:50.968688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b5aa9-aa6d-4f12-bf65-c607ffa7ee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:50.969670 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5aa9-aa6d-4f12-bf65-c607ffa7ee7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.970032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5aa9-aa6d-4f12-bf65-c607ffa7ee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.970447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5aa9-aa6d-4f12-bf65-c607ffa7ee7b admin admin] PATH_INFO: `/v3/projects/1b36f322ee9e4a248ffeb7afe577912e/users/b7223ca6d33f444ea8201df1e95dff4b/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:50.972474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-02432644-29e4-45a7-abd5-c01e05411fcd None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:50.973401 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-02432644-29e4-45a7-abd5-c01e05411fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:50.974783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b5aa9-aa6d-4f12-bf65-c607ffa7ee7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b36f322ee9e4a248ffeb7afe577912e, user_id=b7223ca6d33f444ea8201df1e95dff4b, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:50.979427 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b5aa9-aa6d-4f12-bf65-c607ffa7ee7b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:50.987532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 939/1857] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:50.987532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02432644-29e4-45a7-abd5-c01e05411fcd None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:50.996344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 919/1858] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:50 2022] PUT /identity/v3/projects/1b36f322ee9e4a248ffeb7afe577912e/users/b7223ca6d33f444ea8201df1e95dff4b/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:50.997566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4a7f5-5dcb-44d1-8744-402b6254ee0f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:50.997930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02432644-29e4-45a7-abd5-c01e05411fcd None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:50.998031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4a7f5-5dcb-44d1-8744-402b6254ee0f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:50.998276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4a7f5-5dcb-44d1-8744-402b6254ee0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.018587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-88b4a7f5-5dcb-44d1-8744-402b6254ee0f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:51.020067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-88b4a7f5-5dcb-44d1-8744-402b6254ee0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:51.062807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0988805-af0a-4127-9804-fb00f0b49520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.063578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0988805-af0a-4127-9804-fb00f0b49520 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.063872 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0988805-af0a-4127-9804-fb00f0b49520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.064312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0988805-af0a-4127-9804-fb00f0b49520 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.065270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0988805-af0a-4127-9804-fb00f0b49520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:51.065595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0988805-af0a-4127-9804-fb00f0b49520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.067278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0988805-af0a-4127-9804-fb00f0b49520 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.080249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 940/1859] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:51.081090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0988805-af0a-4127-9804-fb00f0b49520 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.087654 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 920/1860] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:51.089130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bb8bc-7d4a-439c-8a2b-9f34b501c9a4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.089417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bb8bc-7d4a-439c-8a2b-9f34b501c9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.089701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bb8bc-7d4a-439c-8a2b-9f34b501c9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.091841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0988805-af0a-4127-9804-fb00f0b49520 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.096588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39b808-1fea-48f6-a525-b211616b8744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.097246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39b808-1fea-48f6-a525-b211616b8744 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.097535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39b808-1fea-48f6-a525-b211616b8744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.097814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39b808-1fea-48f6-a525-b211616b8744 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.098666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39b808-1fea-48f6-a525-b211616b8744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:51.098892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39b808-1fea-48f6-a525-b211616b8744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.100495 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39b808-1fea-48f6-a525-b211616b8744 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.108298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:51.119191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 941/1861] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:51.119997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39b808-1fea-48f6-a525-b211616b8744 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.121574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c98bb8bc-7d4a-439c-8a2b-9f34b501c9a4 None None] MFA Rules not processed for user `b7223ca6d33f444ea8201df1e95dff4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:51.122826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c98bb8bc-7d4a-439c-8a2b-9f34b501c9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:51.130139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39b808-1fea-48f6-a525-b211616b8744 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.136273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1be88c-01f9-4d15-be7d-c107efd872ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.136941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1be88c-01f9-4d15-be7d-c107efd872ed admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.137233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1be88c-01f9-4d15-be7d-c107efd872ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.137516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1be88c-01f9-4d15-be7d-c107efd872ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.138255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1be88c-01f9-4d15-be7d-c107efd872ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.140182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1be88c-01f9-4d15-be7d-c107efd872ed admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.167218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 942/1862] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:51 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:51.168078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1be88c-01f9-4d15-be7d-c107efd872ed admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.196241 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 921/1863] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:51.197078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bb8bc-7d4a-439c-8a2b-9f34b501c9a4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.207553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bb8bc-7d4a-439c-8a2b-9f34b501c9a4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.217781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:51.238669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1be88c-01f9-4d15-be7d-c107efd872ed admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.244478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdee653-80f5-4a2c-b7dc-f0b895a33943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.245171 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee653-80f5-4a2c-b7dc-f0b895a33943 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.245464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee653-80f5-4a2c-b7dc-f0b895a33943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.245747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee653-80f5-4a2c-b7dc-f0b895a33943 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.246611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdee653-80f5-4a2c-b7dc-f0b895a33943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:51.246909 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdee653-80f5-4a2c-b7dc-f0b895a33943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.249009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdee653-80f5-4a2c-b7dc-f0b895a33943 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.262983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 943/1864] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:51.263809 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdee653-80f5-4a2c-b7dc-f0b895a33943 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.273643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdee653-80f5-4a2c-b7dc-f0b895a33943 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.274239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99577f9-747e-4f90-8a2d-67260dcdd5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.274923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99577f9-747e-4f90-8a2d-67260dcdd5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.275209 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99577f9-747e-4f90-8a2d-67260dcdd5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.275519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99577f9-747e-4f90-8a2d-67260dcdd5e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.276271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99577f9-747e-4f90-8a2d-67260dcdd5e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.278311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99577f9-747e-4f90-8a2d-67260dcdd5e1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.278727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63828c-85d4-4e55-be9d-ff9d9a6a8917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.279407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63828c-85d4-4e55-be9d-ff9d9a6a8917 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.279694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63828c-85d4-4e55-be9d-ff9d9a6a8917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.279977 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63828c-85d4-4e55-be9d-ff9d9a6a8917 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.280681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63828c-85d4-4e55-be9d-ff9d9a6a8917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.282668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63828c-85d4-4e55-be9d-ff9d9a6a8917 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.305037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 922/1865] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:51 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:51.305932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 944/1866] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:51 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:51.306656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99577f9-747e-4f90-8a2d-67260dcdd5e1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.306989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63828c-85d4-4e55-be9d-ff9d9a6a8917 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.309827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c99577f9-747e-4f90-8a2d-67260dcdd5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:51.317354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63828c-85d4-4e55-be9d-ff9d9a6a8917 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.368295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99577f9-747e-4f90-8a2d-67260dcdd5e1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.372091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15335b64-0c36-4505-894f-fb899dd2bc82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.372762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15335b64-0c36-4505-894f-fb899dd2bc82 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.373044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15335b64-0c36-4505-894f-fb899dd2bc82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.373322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15335b64-0c36-4505-894f-fb899dd2bc82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.375411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-15335b64-0c36-4505-894f-fb899dd2bc82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:51.381494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4abd3a-f4dc-4206-8fa4-743926dddedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.382890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4abd3a-f4dc-4206-8fa4-743926dddedb admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.383239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4abd3a-f4dc-4206-8fa4-743926dddedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.383502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4abd3a-f4dc-4206-8fa4-743926dddedb admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.384453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4abd3a-f4dc-4206-8fa4-743926dddedb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.386439 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4abd3a-f4dc-4206-8fa4-743926dddedb admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.412590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 945/1867] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:51 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:51.414278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4abd3a-f4dc-4206-8fa4-743926dddedb admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.442964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15335b64-0c36-4505-894f-fb899dd2bc82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.444448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15335b64-0c36-4505-894f-fb899dd2bc82 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.453943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 923/1868] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:51.455435 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15335b64-0c36-4505-894f-fb899dd2bc82 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.456627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:51.471053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15335b64-0c36-4505-894f-fb899dd2bc82 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.475342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436bc67-5f1b-492f-9b9d-7fe926db778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.476622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436bc67-5f1b-492f-9b9d-7fe926db778f admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.476943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436bc67-5f1b-492f-9b9d-7fe926db778f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.477340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436bc67-5f1b-492f-9b9d-7fe926db778f admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.478044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436bc67-5f1b-492f-9b9d-7fe926db778f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.480010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436bc67-5f1b-492f-9b9d-7fe926db778f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.480141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4abd3a-f4dc-4206-8fa4-743926dddedb admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.485523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96407b1a-7710-4728-8db6-751eab3e3504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.486462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96407b1a-7710-4728-8db6-751eab3e3504 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.487573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96407b1a-7710-4728-8db6-751eab3e3504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.488780 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96407b1a-7710-4728-8db6-751eab3e3504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.491078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96407b1a-7710-4728-8db6-751eab3e3504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.494102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96407b1a-7710-4728-8db6-751eab3e3504 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.502291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 924/1869] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:51 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:51.503282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436bc67-5f1b-492f-9b9d-7fe926db778f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.509958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 946/1870] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:51.511100 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96407b1a-7710-4728-8db6-751eab3e3504 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.514355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436bc67-5f1b-492f-9b9d-7fe926db778f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.519846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589b68-d8c0-448b-abfe-e58512de5410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.520518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589b68-d8c0-448b-abfe-e58512de5410 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.520804 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589b68-d8c0-448b-abfe-e58512de5410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.521082 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17589b68-d8c0-448b-abfe-e58512de5410 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.521314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96407b1a-7710-4728-8db6-751eab3e3504 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.521772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589b68-d8c0-448b-abfe-e58512de5410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.523808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17589b68-d8c0-448b-abfe-e58512de5410 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.526548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdef1c-65f0-4c43-bd29-0dcc17d26c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.527226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdef1c-65f0-4c43-bd29-0dcc17d26c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.527515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdef1c-65f0-4c43-bd29-0dcc17d26c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.527796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdef1c-65f0-4c43-bd29-0dcc17d26c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.528530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdef1c-65f0-4c43-bd29-0dcc17d26c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.530405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdef1c-65f0-4c43-bd29-0dcc17d26c6a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.543459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 947/1871] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:51.544348 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdef1c-65f0-4c43-bd29-0dcc17d26c6a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.548620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 925/1872] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:51 2022] POST /identity/v3/users => generated 283 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:51.549329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589b68-d8c0-448b-abfe-e58512de5410 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.558344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdef1c-65f0-4c43-bd29-0dcc17d26c6a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.560329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17589b68-d8c0-448b-abfe-e58512de5410 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.565010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921b90e-f542-4a83-819e-6390ff077646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.565590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041faf8-2a23-4e54-8f32-a03b9489b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.566219 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921b90e-f542-4a83-819e-6390ff077646 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.566326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041faf8-2a23-4e54-8f32-a03b9489b79d admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.566588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041faf8-2a23-4e54-8f32-a03b9489b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.566868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041faf8-2a23-4e54-8f32-a03b9489b79d admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.566998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921b90e-f542-4a83-819e-6390ff077646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.567250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921b90e-f542-4a83-819e-6390ff077646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.567604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041faf8-2a23-4e54-8f32-a03b9489b79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.567998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921b90e-f542-4a83-819e-6390ff077646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.569211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041faf8-2a23-4e54-8f32-a03b9489b79d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.569857 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921b90e-f542-4a83-819e-6390ff077646 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.584567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 926/1873] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:51.584717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 948/1874] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:51.584799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921b90e-f542-4a83-819e-6390ff077646 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.587408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041faf8-2a23-4e54-8f32-a03b9489b79d admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.597113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921b90e-f542-4a83-819e-6390ff077646 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.597297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041faf8-2a23-4e54-8f32-a03b9489b79d admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.603329 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65865f94-359e-4bf9-9d90-2601932a8a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.604397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65865f94-359e-4bf9-9d90-2601932a8a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.604690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65865f94-359e-4bf9-9d90-2601932a8a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.604995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65865f94-359e-4bf9-9d90-2601932a8a85 admin admin] PATH_INFO: `/v3/projects/4c5002ba88804a048f3e7d9b20bcf39c/users/88c87225635d4af89d1a9ba046064d28/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.605560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a55266-51c2-4963-8d0b-5bfdbd214654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.606517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a55266-51c2-4963-8d0b-5bfdbd214654 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.606773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a55266-51c2-4963-8d0b-5bfdbd214654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.607017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a55266-51c2-4963-8d0b-5bfdbd214654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.607744 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a55266-51c2-4963-8d0b-5bfdbd214654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.609434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a55266-51c2-4963-8d0b-5bfdbd214654 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.611690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:51.623044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65865f94-359e-4bf9-9d90-2601932a8a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c5002ba88804a048f3e7d9b20bcf39c, user_id=88c87225635d4af89d1a9ba046064d28, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.625518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 927/1875] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:51.625717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65865f94-359e-4bf9-9d90-2601932a8a85 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.629962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a55266-51c2-4963-8d0b-5bfdbd214654 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.642289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a55266-51c2-4963-8d0b-5bfdbd214654 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.646280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 949/1876] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:51 2022] PUT /identity/v3/projects/4c5002ba88804a048f3e7d9b20bcf39c/users/88c87225635d4af89d1a9ba046064d28/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:51.649145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65865f94-359e-4bf9-9d90-2601932a8a85 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.748390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453e9ed-c9c3-4835-b6a3-99abe8912b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.749997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453e9ed-c9c3-4835-b6a3-99abe8912b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.750545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453e9ed-c9c3-4835-b6a3-99abe8912b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.750998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453e9ed-c9c3-4835-b6a3-99abe8912b76 admin admin] PATH_INFO: `/v3/projects/de5020e45ded4d9bae1cd1abdb908b69/users/1fee086268424f24bdb8da3bd88cb08f/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.764529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65865f94-359e-4bf9-9d90-2601932a8a85 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.769821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9dbf3d-e163-4964-b3ca-d6f47cd6fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.770617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dbf3d-e163-4964-b3ca-d6f47cd6fa12 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.770913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dbf3d-e163-4964-b3ca-d6f47cd6fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.771197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dbf3d-e163-4964-b3ca-d6f47cd6fa12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.772088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9dbf3d-e163-4964-b3ca-d6f47cd6fa12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.774850 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9dbf3d-e163-4964-b3ca-d6f47cd6fa12 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.786561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453e9ed-c9c3-4835-b6a3-99abe8912b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5020e45ded4d9bae1cd1abdb908b69, user_id=1fee086268424f24bdb8da3bd88cb08f, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.790989 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453e9ed-c9c3-4835-b6a3-99abe8912b76 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.801418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 950/1877] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:51.802620 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e1ee-7ede-4aa9-b673-a8ed945081ad None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.802916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e1ee-7ede-4aa9-b673-a8ed945081ad None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.803346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39e1ee-7ede-4aa9-b673-a8ed945081ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.815696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 928/1878] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:51 2022] PUT /identity/v3/projects/de5020e45ded4d9bae1cd1abdb908b69/users/1fee086268424f24bdb8da3bd88cb08f/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:51.816806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453e9ed-c9c3-4835-b6a3-99abe8912b76 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:51.859710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-3f39e1ee-7ede-4aa9-b673-a8ed945081ad None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:51.860968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3f39e1ee-7ede-4aa9-b673-a8ed945081ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:51.916320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453e9ed-c9c3-4835-b6a3-99abe8912b76 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:51.921686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ac239-2ce6-47e4-ad53-b37fe76fe575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:51.922834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ac239-2ce6-47e4-ad53-b37fe76fe575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.923328 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ac239-2ce6-47e4-ad53-b37fe76fe575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.923618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ac239-2ce6-47e4-ad53-b37fe76fe575 admin admin] PATH_INFO: `/v3/projects/62ace54e31a4439f822f7bd69a6b3fda/users/e0a7a9d46e2544819a2643b4ae1492d8/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.941250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ac239-2ce6-47e4-ad53-b37fe76fe575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ace54e31a4439f822f7bd69a6b3fda, user_id=e0a7a9d46e2544819a2643b4ae1492d8, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:51.944035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ac239-2ce6-47e4-ad53-b37fe76fe575 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:51.964183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 929/1879] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:51 2022] PUT /identity/v3/projects/62ace54e31a4439f822f7bd69a6b3fda/users/e0a7a9d46e2544819a2643b4ae1492d8/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:51.973875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 951/1880] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:51.973875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85071a-4094-42d1-ac8e-371341a12690 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.973875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85071a-4094-42d1-ac8e-371341a12690 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.973875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85071a-4094-42d1-ac8e-371341a12690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:51.976663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a81929-756b-40a5-b728-346887b1ab85 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:51.976929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a81929-756b-40a5-b728-346887b1ab85 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:51.977209 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a81929-756b-40a5-b728-346887b1ab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:52.001291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-cd85071a-4094-42d1-ac8e-371341a12690 None None] MFA Rules not processed for user `1fee086268424f24bdb8da3bd88cb08f`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:52.003519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cd85071a-4094-42d1-ac8e-371341a12690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:52.027516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-22a81929-756b-40a5-b728-346887b1ab85 None None] MFA Rules not processed for user `e0a7a9d46e2544819a2643b4ae1492d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:52.029115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-22a81929-756b-40a5-b728-346887b1ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:52.032041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:52.189454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:52.193196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 952/1881] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:52.193196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85071a-4094-42d1-ac8e-371341a12690 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:52.193196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cd85071a-4094-42d1-ac8e-371341a12690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:52.232996 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 930/1882] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:52.236187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a81929-756b-40a5-b728-346887b1ab85 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:52.410955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85071a-4094-42d1-ac8e-371341a12690 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:52.447045 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92181899-7fab-4d4e-92f5-13121cd6bed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:52.451044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92181899-7fab-4d4e-92f5-13121cd6bed2 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:52.451373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92181899-7fab-4d4e-92f5-13121cd6bed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:52.451664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92181899-7fab-4d4e-92f5-13121cd6bed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:52.509985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a81929-756b-40a5-b728-346887b1ab85 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:52.525943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd828d5-af61-4d92-995a-6415d350c78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:52.526848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd828d5-af61-4d92-995a-6415d350c78c admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:52.527136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd828d5-af61-4d92-995a-6415d350c78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:52.527856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd828d5-af61-4d92-995a-6415d350c78c admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:52.528578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd828d5-af61-4d92-995a-6415d350c78c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:52.546369 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd828d5-af61-4d92-995a-6415d350c78c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:52.595430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 931/1883] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:52 2022] POST /identity/v3/projects => generated 385 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:52.596885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd828d5-af61-4d92-995a-6415d350c78c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:52.614711 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92181899-7fab-4d4e-92f5-13121cd6bed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:52.616239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92181899-7fab-4d4e-92f5-13121cd6bed2 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:52.628614 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 953/1884] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:52.629552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92181899-7fab-4d4e-92f5-13121cd6bed2 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:52.641242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92181899-7fab-4d4e-92f5-13121cd6bed2 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:52.675220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd828d5-af61-4d92-995a-6415d350c78c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:52.681923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00a8fa-6b49-4dff-9632-7485d8b902bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:52.682842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a8fa-6b49-4dff-9632-7485d8b902bc admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:52.683205 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a8fa-6b49-4dff-9632-7485d8b902bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:52.683550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00a8fa-6b49-4dff-9632-7485d8b902bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:52.684496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00a8fa-6b49-4dff-9632-7485d8b902bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:52.686548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00a8fa-6b49-4dff-9632-7485d8b902bc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:52.720790 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 932/1885] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:52 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:52.725634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00a8fa-6b49-4dff-9632-7485d8b902bc admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:52.727619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9fe33-b04d-47f4-94ac-bc9c88b26886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:52.728625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9fe33-b04d-47f4-94ac-bc9c88b26886 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:52.729000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9fe33-b04d-47f4-94ac-bc9c88b26886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:52.729359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9fe33-b04d-47f4-94ac-bc9c88b26886 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:52.730258 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9fe33-b04d-47f4-94ac-bc9c88b26886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:52.733102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9fe33-b04d-47f4-94ac-bc9c88b26886 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:52.747324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:52.763122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 954/1886] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:52 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:52.767224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9fe33-b04d-47f4-94ac-bc9c88b26886 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:52.780917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9fe33-b04d-47f4-94ac-bc9c88b26886 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:52.808864 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00a8fa-6b49-4dff-9632-7485d8b902bc admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:52.815863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c519d1-51a9-459f-94ef-9d2cdd7bf508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:52.816722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c519d1-51a9-459f-94ef-9d2cdd7bf508 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:52.817012 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c519d1-51a9-459f-94ef-9d2cdd7bf508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:52.817293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c519d1-51a9-459f-94ef-9d2cdd7bf508 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:52.818140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c519d1-51a9-459f-94ef-9d2cdd7bf508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:52.823326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c519d1-51a9-459f-94ef-9d2cdd7bf508 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:52.833895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:52.863982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 933/1887] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:52 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:52.867392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c519d1-51a9-459f-94ef-9d2cdd7bf508 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:52.881072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c519d1-51a9-459f-94ef-9d2cdd7bf508 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:52.889345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af4af4-fe26-429b-9db0-f549eb52ce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:52.890482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af4af4-fe26-429b-9db0-f549eb52ce9f admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:52.890807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af4af4-fe26-429b-9db0-f549eb52ce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:52.891110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af4af4-fe26-429b-9db0-f549eb52ce9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:52.892028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af4af4-fe26-429b-9db0-f549eb52ce9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:52.896294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af4af4-fe26-429b-9db0-f549eb52ce9f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:52.915796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 934/1888] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:13:52.920391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af4af4-fe26-429b-9db0-f549eb52ce9f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:52.932011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216afed-7e46-4454-9667-fe9825ff8600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:52.932711 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216afed-7e46-4454-9667-fe9825ff8600 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:52.933003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216afed-7e46-4454-9667-fe9825ff8600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:52.933323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216afed-7e46-4454-9667-fe9825ff8600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:52.934068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216afed-7e46-4454-9667-fe9825ff8600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:52.935968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216afed-7e46-4454-9667-fe9825ff8600 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:52.938920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af4af4-fe26-429b-9db0-f549eb52ce9f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:52.946512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde1102-9da5-4586-a1a6-20d8e3e14391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:52.947902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde1102-9da5-4586-a1a6-20d8e3e14391 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:52.948540 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde1102-9da5-4586-a1a6-20d8e3e14391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:52.949037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde1102-9da5-4586-a1a6-20d8e3e14391 admin admin] PATH_INFO: `/v3/projects/e8bc79059afb414faf361f7745677979/users/d8ea32456ddd47c291ff73b93150ed7e/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:52.955078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 955/1889] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:52.959581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216afed-7e46-4454-9667-fe9825ff8600 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:52.984603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216afed-7e46-4454-9667-fe9825ff8600 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:52.989001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde1102-9da5-4586-a1a6-20d8e3e14391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bc79059afb414faf361f7745677979, user_id=d8ea32456ddd47c291ff73b93150ed7e, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:52.997483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde1102-9da5-4586-a1a6-20d8e3e14391 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:53.007214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafb256-9767-477a-9ab4-cd4e3718adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:53.008409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafb256-9767-477a-9ab4-cd4e3718adaf admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:53.008705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafb256-9767-477a-9ab4-cd4e3718adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:53.008989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafb256-9767-477a-9ab4-cd4e3718adaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:53.010201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafb256-9767-477a-9ab4-cd4e3718adaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:53.012176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafb256-9767-477a-9ab4-cd4e3718adaf admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:53.038782 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 935/1890] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:52 2022] PUT /identity/v3/projects/e8bc79059afb414faf361f7745677979/users/d8ea32456ddd47c291ff73b93150ed7e/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:53.040473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde1102-9da5-4586-a1a6-20d8e3e14391 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:53.053471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 956/1891] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:53.056761 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafb256-9767-477a-9ab4-cd4e3718adaf admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:53.097965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafb256-9767-477a-9ab4-cd4e3718adaf admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:53.313395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde1102-9da5-4586-a1a6-20d8e3e14391 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:53.324336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d6ffe-a359-4e46-a006-c110019c99b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:53.339428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6ffe-a359-4e46-a006-c110019c99b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:53.339797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6ffe-a359-4e46-a006-c110019c99b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:53.340099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6ffe-a359-4e46-a006-c110019c99b1 admin admin] PATH_INFO: `/v3/projects/91aed36d1adf420e80cf232728f00c50/users/4ca7efe16e934b24b8b8730247b10c4b/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:53.354857 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37646863-7058-4fd4-bc3b-b6983c6bb112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:53.356928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37646863-7058-4fd4-bc3b-b6983c6bb112 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:53.360154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37646863-7058-4fd4-bc3b-b6983c6bb112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:53.360675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37646863-7058-4fd4-bc3b-b6983c6bb112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:53.361645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37646863-7058-4fd4-bc3b-b6983c6bb112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:53.365369 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37646863-7058-4fd4-bc3b-b6983c6bb112 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:53.391530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d6ffe-a359-4e46-a006-c110019c99b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91aed36d1adf420e80cf232728f00c50, user_id=4ca7efe16e934b24b8b8730247b10c4b, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:53.397206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 936/1892] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:53.399105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d6ffe-a359-4e46-a006-c110019c99b1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:53.400039 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37646863-7058-4fd4-bc3b-b6983c6bb112 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:53.421673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37646863-7058-4fd4-bc3b-b6983c6bb112 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:53.424682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 957/1893] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:53 2022] PUT /identity/v3/projects/91aed36d1adf420e80cf232728f00c50/users/4ca7efe16e934b24b8b8730247b10c4b/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:53.434980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec842-5461-4468-8c22-4682f02f5931 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:53.435277 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec842-5461-4468-8c22-4682f02f5931 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:53.435562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deec842-5461-4468-8c22-4682f02f5931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:53.486840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1deec842-5461-4468-8c22-4682f02f5931 None None] MFA Rules not processed for user `4ca7efe16e934b24b8b8730247b10c4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:53.488249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1deec842-5461-4468-8c22-4682f02f5931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:53.535339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1e2ae-2af0-436f-a2c9-8dc1f1ec754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:53.536925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e2ae-2af0-436f-a2c9-8dc1f1ec754a admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:53.539689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e2ae-2af0-436f-a2c9-8dc1f1ec754a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:53.540061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e2ae-2af0-436f-a2c9-8dc1f1ec754a admin admin] PATH_INFO: `/v3/projects/e8bc79059afb414faf361f7745677979/users/d8ea32456ddd47c291ff73b93150ed7e/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:53.546127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1e2ae-2af0-436f-a2c9-8dc1f1ec754a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bc79059afb414faf361f7745677979, user_id=d8ea32456ddd47c291ff73b93150ed7e, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:53.550817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1e2ae-2af0-436f-a2c9-8dc1f1ec754a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:53.558445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:53.569205 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 937/1894] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:53 2022] PUT /identity/v3/projects/e8bc79059afb414faf361f7745677979/users/d8ea32456ddd47c291ff73b93150ed7e/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:53.580936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89217-2f1a-490b-ba29-62d48bad2692 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:53.581238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89217-2f1a-490b-ba29-62d48bad2692 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:53.584316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b89217-2f1a-490b-ba29-62d48bad2692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:53.603699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 958/1895] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:13:53.608766 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deec842-5461-4468-8c22-4682f02f5931 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:53.638278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deec842-5461-4468-8c22-4682f02f5931 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:53.647100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a8b89217-2f1a-490b-ba29-62d48bad2692 None None] MFA Rules not processed for user `d8ea32456ddd47c291ff73b93150ed7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:53.660845 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a8b89217-2f1a-490b-ba29-62d48bad2692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:53.735669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:53.803379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a5246-8062-4c9e-abab-6d4db9768cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:53.803662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a5246-8062-4c9e-abab-6d4db9768cdb admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:53.804496 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a5246-8062-4c9e-abab-6d4db9768cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:53.804826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a5246-8062-4c9e-abab-6d4db9768cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:53.805613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a5246-8062-4c9e-abab-6d4db9768cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:53.808627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a5246-8062-4c9e-abab-6d4db9768cdb admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:53.848489 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 959/1896] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:53 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:53.848489 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a5246-8062-4c9e-abab-6d4db9768cdb admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:53.848489 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-385a5246-8062-4c9e-abab-6d4db9768cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:53.858066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 938/1897] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:53.860131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89217-2f1a-490b-ba29-62d48bad2692 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:53.875653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b89217-2f1a-490b-ba29-62d48bad2692 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:53.945342 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a5246-8062-4c9e-abab-6d4db9768cdb admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:53.950133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:53.951092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20975f6c-ad2a-4f7a-8492-8555d075e9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:53.951260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:53.951537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:53.951820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] PATH_INFO: `/v3/users/38cfbb3cac2f45bcacbe32c97c491709` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:53.952065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20975f6c-ad2a-4f7a-8492-8555d075e9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:53.952421 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20975f6c-ad2a-4f7a-8492-8555d075e9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:53.952753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20975f6c-ad2a-4f7a-8492-8555d075e9cd admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:53.953096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38cfbb3cac2f45bcacbe32c97c491709)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:53.953591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20975f6c-ad2a-4f7a-8492-8555d075e9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:53.955088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:53.955737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20975f6c-ad2a-4f7a-8492-8555d075e9cd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:53.981222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 939/1898] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:53 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:53.982051 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20975f6c-ad2a-4f7a-8492-8555d075e9cd admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:53.983881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-20975f6c-ad2a-4f7a-8492-8555d075e9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.019245 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38cfbb3cac2f45bcacbe32c97c491709'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:54.019946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38cfbb3cac2f45bcacbe32c97c491709'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:54.020995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38cfbb3cac2f45bcacbe32c97c491709'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:54.030496 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38cfbb3cac2f45bcacbe32c97c491709'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:54.040898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38cfbb3cac2f45bcacbe32c97c491709'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:54.056287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20975f6c-ad2a-4f7a-8492-8555d075e9cd admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:54.057586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:54.061111 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c67de-170e-4e58-b18f-b82b0917caa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:54.061784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c67de-170e-4e58-b18f-b82b0917caa8 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.062449 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c67de-170e-4e58-b18f-b82b0917caa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.062917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c67de-170e-4e58-b18f-b82b0917caa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.065175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9c1c67de-170e-4e58-b18f-b82b0917caa8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.072476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 960/1899] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:53 2022] DELETE /identity/v3/users/38cfbb3cac2f45bcacbe32c97c491709 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:54.073858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:54.079295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.165633 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c67de-170e-4e58-b18f-b82b0917caa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:54.167213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c67de-170e-4e58-b18f-b82b0917caa8 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:54.170291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5f676-50c0-44c3-9379-82d5cfcafac6 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:54.175256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fef0f6-0e99-49d2-8ebf-d32c9f0d32ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:54.176010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fef0f6-0e99-49d2-8ebf-d32c9f0d32ef admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.176359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fef0f6-0e99-49d2-8ebf-d32c9f0d32ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.176708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fef0f6-0e99-49d2-8ebf-d32c9f0d32ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.177656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fef0f6-0e99-49d2-8ebf-d32c9f0d32ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:54.178980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 940/1900] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:54.180381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fef0f6-0e99-49d2-8ebf-d32c9f0d32ef admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:54.180903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f4fd8-eb3c-4896-9dbb-e8448e49a743 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.181255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f4fd8-eb3c-4896-9dbb-e8448e49a743 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.181602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f4fd8-eb3c-4896-9dbb-e8448e49a743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.193443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 961/1901] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:54.198588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fef0f6-0e99-49d2-8ebf-d32c9f0d32ef admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:54.222692 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fef0f6-0e99-49d2-8ebf-d32c9f0d32ef admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:54.228273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb74af7-425e-4d27-9d65-cd27a2d356c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:54.229312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb74af7-425e-4d27-9d65-cd27a2d356c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.229725 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb74af7-425e-4d27-9d65-cd27a2d356c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.230106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb74af7-425e-4d27-9d65-cd27a2d356c8 admin admin] PATH_INFO: `/v3/projects/d9475ecf565e49379c31dad5f12bb2ea/users/8017883444a84561ac34f76e98fac87a/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.234525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-745f4fd8-eb3c-4896-9dbb-e8448e49a743 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:54.238765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-745f4fd8-eb3c-4896-9dbb-e8448e49a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.251157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb74af7-425e-4d27-9d65-cd27a2d356c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9475ecf565e49379c31dad5f12bb2ea, user_id=8017883444a84561ac34f76e98fac87a, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:54.253457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 941/1902] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:54.254894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb74af7-425e-4d27-9d65-cd27a2d356c8 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:54.264688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f4fd8-eb3c-4896-9dbb-e8448e49a743 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:54.266998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-745f4fd8-eb3c-4896-9dbb-e8448e49a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.274294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 962/1903] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:54 2022] PUT /identity/v3/projects/d9475ecf565e49379c31dad5f12bb2ea/users/8017883444a84561ac34f76e98fac87a/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:54.274455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:54.276599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb74af7-425e-4d27-9d65-cd27a2d356c8 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:54.355338 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f4fd8-eb3c-4896-9dbb-e8448e49a743 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:54.367442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb74af7-425e-4d27-9d65-cd27a2d356c8 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:54.372537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1a169-f7b7-49cb-ad1a-d018e369e225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:54.383433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a169-f7b7-49cb-ad1a-d018e369e225 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.383433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a169-f7b7-49cb-ad1a-d018e369e225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.383433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a169-f7b7-49cb-ad1a-d018e369e225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.383433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1a169-f7b7-49cb-ad1a-d018e369e225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:54.383433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1a169-f7b7-49cb-ad1a-d018e369e225 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:54.391759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 963/1904] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:54.392669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1a169-f7b7-49cb-ad1a-d018e369e225 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:54.394609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-71a1a169-f7b7-49cb-ad1a-d018e369e225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.421052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d22e67-e314-4803-81c1-edcc394b3b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:54.421777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d22e67-e314-4803-81c1-edcc394b3b52 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.422009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d22e67-e314-4803-81c1-edcc394b3b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.422385 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d22e67-e314-4803-81c1-edcc394b3b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.434327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d22e67-e314-4803-81c1-edcc394b3b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:54.435823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d22e67-e314-4803-81c1-edcc394b3b52 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:54.447846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 942/1905] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:54.449169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae538d-0e62-4d20-bf56-d2c84bcf0381 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.449460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae538d-0e62-4d20-bf56-d2c84bcf0381 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.449720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae538d-0e62-4d20-bf56-d2c84bcf0381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.471217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1a169-f7b7-49cb-ad1a-d018e369e225 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:54.475237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07435-f0c7-458a-9e5a-90f3eab86fd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:54.475947 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07435-f0c7-458a-9e5a-90f3eab86fd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.476233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07435-f0c7-458a-9e5a-90f3eab86fd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.476521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07435-f0c7-458a-9e5a-90f3eab86fd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.478459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6af07435-f0c7-458a-9e5a-90f3eab86fd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.487817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c7ae538d-0e62-4d20-bf56-d2c84bcf0381 None None] MFA Rules not processed for user `88c87225635d4af89d1a9ba046064d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:54.493680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c7ae538d-0e62-4d20-bf56-d2c84bcf0381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.500475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:54.580019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af07435-f0c7-458a-9e5a-90f3eab86fd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:54.581780 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af07435-f0c7-458a-9e5a-90f3eab86fd1 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:54.602893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 964/1906] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:54.603371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07435-f0c7-458a-9e5a-90f3eab86fd1 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:54.608846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 943/1907] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:54.613815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae538d-0e62-4d20-bf56-d2c84bcf0381 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:54.618807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07435-f0c7-458a-9e5a-90f3eab86fd1 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:54.621685 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c7ae538d-0e62-4d20-bf56-d2c84bcf0381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.625377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72b645-1db5-472d-9f17-43061a61e887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:54.626571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b645-1db5-472d-9f17-43061a61e887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.626934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b645-1db5-472d-9f17-43061a61e887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.627289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b645-1db5-472d-9f17-43061a61e887 admin admin] PATH_INFO: `/v3/projects/d9475ecf565e49379c31dad5f12bb2ea/users/8017883444a84561ac34f76e98fac87a/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.629484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72b645-1db5-472d-9f17-43061a61e887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9475ecf565e49379c31dad5f12bb2ea, user_id=8017883444a84561ac34f76e98fac87a, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:54.634643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72b645-1db5-472d-9f17-43061a61e887 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:54.644745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae538d-0e62-4d20-bf56-d2c84bcf0381 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:54.650579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52cc73-38aa-43e8-8dcd-deea69b9d5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:54.652117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52cc73-38aa-43e8-8dcd-deea69b9d5c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.652478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52cc73-38aa-43e8-8dcd-deea69b9d5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.653192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52cc73-38aa-43e8-8dcd-deea69b9d5c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.653926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52cc73-38aa-43e8-8dcd-deea69b9d5c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:54.656076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da52cc73-38aa-43e8-8dcd-deea69b9d5c8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:54.686506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 965/1908] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:54 2022] PUT /identity/v3/projects/d9475ecf565e49379c31dad5f12bb2ea/users/8017883444a84561ac34f76e98fac87a/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:54.696073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 944/1909] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:54 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:54.698196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb4e1f-68eb-48a1-a80d-f697bf0bf976 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.698196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb4e1f-68eb-48a1-a80d-f697bf0bf976 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.698422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb4e1f-68eb-48a1-a80d-f697bf0bf976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.700987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52cc73-38aa-43e8-8dcd-deea69b9d5c8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:54.758973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a6bb4e1f-68eb-48a1-a80d-f697bf0bf976 None None] MFA Rules not processed for user `8017883444a84561ac34f76e98fac87a`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:54.761448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a6bb4e1f-68eb-48a1-a80d-f697bf0bf976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.768197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:54.854287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52cc73-38aa-43e8-8dcd-deea69b9d5c8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:54.862489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00040bc-3dcc-47ea-9e05-3d89b7e88cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:54.863625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00040bc-3dcc-47ea-9e05-3d89b7e88cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.864010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00040bc-3dcc-47ea-9e05-3d89b7e88cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.864610 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00040bc-3dcc-47ea-9e05-3d89b7e88cdc admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.865660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00040bc-3dcc-47ea-9e05-3d89b7e88cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:54.869661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00040bc-3dcc-47ea-9e05-3d89b7e88cdc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:54.871089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 966/1910] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:13:54.879572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb4e1f-68eb-48a1-a80d-f697bf0bf976 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:54.901089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 945/1911] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:54 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:54.906099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00040bc-3dcc-47ea-9e05-3d89b7e88cdc admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:54.923583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00040bc-3dcc-47ea-9e05-3d89b7e88cdc admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:54.939869 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924733e-4ea1-4a56-9fdb-ff0f13c005d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:54.940863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924733e-4ea1-4a56-9fdb-ff0f13c005d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.941159 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924733e-4ea1-4a56-9fdb-ff0f13c005d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.942017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924733e-4ea1-4a56-9fdb-ff0f13c005d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.942229 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924733e-4ea1-4a56-9fdb-ff0f13c005d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:54.944091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924733e-4ea1-4a56-9fdb-ff0f13c005d8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:54.969311 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb4e1f-68eb-48a1-a80d-f697bf0bf976 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:54.970192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 946/1912] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:54.971308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924733e-4ea1-4a56-9fdb-ff0f13c005d8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:54.973102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9924733e-4ea1-4a56-9fdb-ff0f13c005d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.973317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889726fe-4487-466b-8921-13b41230b281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:54.973964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889726fe-4487-466b-8921-13b41230b281 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:54.974282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889726fe-4487-466b-8921-13b41230b281 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:54.974563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889726fe-4487-466b-8921-13b41230b281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:54.978902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-889726fe-4487-466b-8921-13b41230b281 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:54.996381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924733e-4ea1-4a56-9fdb-ff0f13c005d8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:55.001642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:55.003178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:55.003547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:55.004061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] PATH_INFO: `/v3/projects/f7889c1b5e5f4e32a2238fc1ec8a1d55` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:55.006253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7889c1b5e5f4e32a2238fc1ec8a1d55)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:55.008505 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:55.066555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:55.074477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7889c1b5e5f4e32a2238fc1ec8a1d55', 'request_id': 'req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.080365 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7889c1b5e5f4e32a2238fc1ec8a1d55', 'request_id': 'req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.088180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7889c1b5e5f4e32a2238fc1ec8a1d55', 'request_id': 'req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.091649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889726fe-4487-466b-8921-13b41230b281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:55.093228 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889726fe-4487-466b-8921-13b41230b281 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:55.100618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] The token cache is being invalidate because project f7889c1b5e5f4e32a2238fc1ec8a1d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:55.101445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.102173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.103998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 947/1913] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:54 2022] DELETE /identity/v3/projects/f7889c1b5e5f4e32a2238fc1ec8a1d55 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:55.104108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 967/1914] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:55.104732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:55.106138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:55.107885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889726fe-4487-466b-8921-13b41230b281 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:55.120790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889726fe-4487-466b-8921-13b41230b281 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:55.179653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd0f4c-daf5-422b-a248-9e23fd2dda1f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:55.184974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c9d36-e76c-4462-807a-c22c4b3b3638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:55.185881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c9d36-e76c-4462-807a-c22c4b3b3638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:55.186184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c9d36-e76c-4462-807a-c22c4b3b3638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:55.186477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c9d36-e76c-4462-807a-c22c4b3b3638 admin admin] PATH_INFO: `/v3/projects/fbcc6432d3b04fafa31d8ec4d2e40ac8/users/6f5f844f12c14eeda8c00bdc0de8ddff/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:55.189629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:55.190958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:55.190958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:55.191365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] PATH_INFO: `/v3/users/e13945df24674055aea61dd8a75292bd` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:55.192639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13945df24674055aea61dd8a75292bd)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:55.195170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:55.207465 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c9d36-e76c-4462-807a-c22c4b3b3638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbcc6432d3b04fafa31d8ec4d2e40ac8, user_id=6f5f844f12c14eeda8c00bdc0de8ddff, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:55.214556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c9d36-e76c-4462-807a-c22c4b3b3638 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:55.231925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 948/1915] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:55 2022] PUT /identity/v3/projects/fbcc6432d3b04fafa31d8ec4d2e40ac8/users/6f5f844f12c14eeda8c00bdc0de8ddff/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:55.236256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c9d36-e76c-4462-807a-c22c4b3b3638 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:55.256509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:55.261134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13945df24674055aea61dd8a75292bd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.262360 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13945df24674055aea61dd8a75292bd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.262961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13945df24674055aea61dd8a75292bd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.273545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13945df24674055aea61dd8a75292bd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.284628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13945df24674055aea61dd8a75292bd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.308549 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 968/1916] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:13:55 2022] DELETE /identity/v3/users/e13945df24674055aea61dd8a75292bd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:13:55.317655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c9d36-e76c-4462-807a-c22c4b3b3638 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:55.414131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07e6c3-2504-4ab1-8bf2-bfee21016438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:55.415099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07e6c3-2504-4ab1-8bf2-bfee21016438 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:55.415532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07e6c3-2504-4ab1-8bf2-bfee21016438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:55.416007 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07e6c3-2504-4ab1-8bf2-bfee21016438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:55.417050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07e6c3-2504-4ab1-8bf2-bfee21016438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:55.419143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07e6c3-2504-4ab1-8bf2-bfee21016438 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:55.435792 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 949/1917] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:13:55.449145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:55.450672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:55.478289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac5868-d057-4976-b1e7-fd1305cf0648 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:55.492209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90919634-ccf9-46cd-8b8b-9194cdc245e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:55.493339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90919634-ccf9-46cd-8b8b-9194cdc245e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:55.493631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90919634-ccf9-46cd-8b8b-9194cdc245e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:55.493914 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90919634-ccf9-46cd-8b8b-9194cdc245e3 admin admin] PATH_INFO: `/v3/projects/fbcc6432d3b04fafa31d8ec4d2e40ac8/users/6f5f844f12c14eeda8c00bdc0de8ddff/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:55.496624 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90919634-ccf9-46cd-8b8b-9194cdc245e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbcc6432d3b04fafa31d8ec4d2e40ac8, user_id=6f5f844f12c14eeda8c00bdc0de8ddff, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:55.499845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90919634-ccf9-46cd-8b8b-9194cdc245e3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:55.512310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 969/1918] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:55 2022] PUT /identity/v3/projects/fbcc6432d3b04fafa31d8ec4d2e40ac8/users/6f5f844f12c14eeda8c00bdc0de8ddff/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:55.766895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07e6c3-2504-4ab1-8bf2-bfee21016438 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:55.768870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cf07e6c3-2504-4ab1-8bf2-bfee21016438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:55.784732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07e6c3-2504-4ab1-8bf2-bfee21016438 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:55.853514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:55.854999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:55.855687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:55.855687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] PATH_INFO: `/v3/projects/ba100dbd74f7494e863e4921c4a86a80` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:55.856979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba100dbd74f7494e863e4921c4a86a80)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:55.863388 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:55.920486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba100dbd74f7494e863e4921c4a86a80', 'request_id': 'req-34fa67a7-88b1-410b-97d4-9081cb095ab4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.928244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba100dbd74f7494e863e4921c4a86a80', 'request_id': 'req-34fa67a7-88b1-410b-97d4-9081cb095ab4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.931657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:55.939132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba100dbd74f7494e863e4921c4a86a80', 'request_id': 'req-34fa67a7-88b1-410b-97d4-9081cb095ab4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.953722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] The token cache is being invalidate because project ba100dbd74f7494e863e4921c4a86a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:13:55.954133 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.954807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-34fa67a7-88b1-410b-97d4-9081cb095ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:13:55.956406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 950/1919] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:13:55 2022] DELETE /identity/v3/projects/ba100dbd74f7494e863e4921c4a86a80 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:55.962094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175df33e-92a2-42fa-a0c0-14932d44e313 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:55.962415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175df33e-92a2-42fa-a0c0-14932d44e313 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:55.962711 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175df33e-92a2-42fa-a0c0-14932d44e313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:55.984555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-175df33e-92a2-42fa-a0c0-14932d44e313 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:55.985861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-175df33e-92a2-42fa-a0c0-14932d44e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:56.044926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:56.063323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 970/1920] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:56.073146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc23c77-df0b-4202-8a54-7f8a4dd698ea None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:56.073441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc23c77-df0b-4202-8a54-7f8a4dd698ea None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:56.073757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc23c77-df0b-4202-8a54-7f8a4dd698ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:56.113690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0cc23c77-df0b-4202-8a54-7f8a4dd698ea None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:56.114885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0cc23c77-df0b-4202-8a54-7f8a4dd698ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:56.137576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 951/1921] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:56.143404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175df33e-92a2-42fa-a0c0-14932d44e313 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:56.154960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175df33e-92a2-42fa-a0c0-14932d44e313 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:56.159627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80699b3-0614-44cb-9de5-9c4766f2d1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:56.160484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80699b3-0614-44cb-9de5-9c4766f2d1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:56.160821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80699b3-0614-44cb-9de5-9c4766f2d1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:56.161129 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80699b3-0614-44cb-9de5-9c4766f2d1e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:56.162176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80699b3-0614-44cb-9de5-9c4766f2d1e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:13:56.162495 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80699b3-0614-44cb-9de5-9c4766f2d1e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:56.164606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80699b3-0614-44cb-9de5-9c4766f2d1e4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:56.179303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 971/1922] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:13:56.184501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc23c77-df0b-4202-8a54-7f8a4dd698ea None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:56.195913 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc23c77-df0b-4202-8a54-7f8a4dd698ea None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:56.205367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dead5-ec16-4984-a121-17f3f1710466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:56.206072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dead5-ec16-4984-a121-17f3f1710466 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:56.206407 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dead5-ec16-4984-a121-17f3f1710466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:56.206673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dead5-ec16-4984-a121-17f3f1710466 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:56.207881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dead5-ec16-4984-a121-17f3f1710466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:56.209378 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dead5-ec16-4984-a121-17f3f1710466 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:56.248127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 952/1923] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:56 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:13:56.252215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80699b3-0614-44cb-9de5-9c4766f2d1e4 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:56.265282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80699b3-0614-44cb-9de5-9c4766f2d1e4 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:56.337406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca13bf-4991-4b61-88ce-0d14d3b3a3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:56.338105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca13bf-4991-4b61-88ce-0d14d3b3a3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:56.338459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca13bf-4991-4b61-88ce-0d14d3b3a3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:56.338747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca13bf-4991-4b61-88ce-0d14d3b3a3d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:56.339502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca13bf-4991-4b61-88ce-0d14d3b3a3d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:56.341515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca13bf-4991-4b61-88ce-0d14d3b3a3d8 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:56.374369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 972/1924] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:56 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:13:56.375597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dead5-ec16-4984-a121-17f3f1710466 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:56.409097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dead5-ec16-4984-a121-17f3f1710466 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:56.431696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285f643-4ac4-451d-b201-121926cf3a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:56.432872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285f643-4ac4-451d-b201-121926cf3a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:56.433390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285f643-4ac4-451d-b201-121926cf3a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:56.433805 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285f643-4ac4-451d-b201-121926cf3a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:56.434719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285f643-4ac4-451d-b201-121926cf3a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:56.436713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285f643-4ac4-451d-b201-121926cf3a52 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:56.456090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 953/1925] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:56.456696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca13bf-4991-4b61-88ce-0d14d3b3a3d8 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:56.477737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca13bf-4991-4b61-88ce-0d14d3b3a3d8 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:56.483695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ced709-b66b-4613-ba14-f765f31d5648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:56.484453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ced709-b66b-4613-ba14-f765f31d5648 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:56.484813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ced709-b66b-4613-ba14-f765f31d5648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:56.485182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ced709-b66b-4613-ba14-f765f31d5648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:56.486286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ced709-b66b-4613-ba14-f765f31d5648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:56.488272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ced709-b66b-4613-ba14-f765f31d5648 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:56.504385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 973/1926] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:56.509998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285f643-4ac4-451d-b201-121926cf3a52 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:56.531292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285f643-4ac4-451d-b201-121926cf3a52 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:56.551228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d7140-f8d3-46cb-9eb6-7cba449d2668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:56.553044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d7140-f8d3-46cb-9eb6-7cba449d2668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:56.556577 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d7140-f8d3-46cb-9eb6-7cba449d2668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:56.557081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d7140-f8d3-46cb-9eb6-7cba449d2668 admin admin] PATH_INFO: `/v3/projects/d1d3caabba8647f096c3dce74b8c0aca/users/8a44fd16c5a241de8f683dbb562afe34/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:56.590469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d7140-f8d3-46cb-9eb6-7cba449d2668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d3caabba8647f096c3dce74b8c0aca, user_id=8a44fd16c5a241de8f683dbb562afe34, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:56.595155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d7140-f8d3-46cb-9eb6-7cba449d2668 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:56.640944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 954/1927] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:56 2022] PUT /identity/v3/projects/d1d3caabba8647f096c3dce74b8c0aca/users/8a44fd16c5a241de8f683dbb562afe34/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:56.655256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c7f3b-624c-4015-9c13-b789e812e85f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:56.655705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c7f3b-624c-4015-9c13-b789e812e85f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:56.656134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c7f3b-624c-4015-9c13-b789e812e85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:56.706283 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a72560-2373-4a6a-b969-ddc0d92b1aa5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:56.706663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a72560-2373-4a6a-b969-ddc0d92b1aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:56.707013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a72560-2373-4a6a-b969-ddc0d92b1aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:56.707427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-fa3c7f3b-624c-4015-9c13-b789e812e85f None None] MFA Rules not processed for user `8a44fd16c5a241de8f683dbb562afe34`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:56.709120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fa3c7f3b-624c-4015-9c13-b789e812e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:56.779154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e5a72560-2373-4a6a-b969-ddc0d92b1aa5 None None] MFA Rules not processed for user `6f5f844f12c14eeda8c00bdc0de8ddff`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:56.784410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e5a72560-2373-4a6a-b969-ddc0d92b1aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:56.839267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 974/1928] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:56.841309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c7f3b-624c-4015-9c13-b789e812e85f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:56.946382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:56.950179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 955/1929] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:13:56.964261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a72560-2373-4a6a-b969-ddc0d92b1aa5 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:56.968125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e5a72560-2373-4a6a-b969-ddc0d92b1aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:56.996837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c7f3b-624c-4015-9c13-b789e812e85f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:57.011553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76421121-e86b-40fd-8127-391c3ce5c28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:57.012357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421121-e86b-40fd-8127-391c3ce5c28e admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:57.012715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421121-e86b-40fd-8127-391c3ce5c28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:57.013054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421121-e86b-40fd-8127-391c3ce5c28e admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:57.015486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76421121-e86b-40fd-8127-391c3ce5c28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:57.017807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76421121-e86b-40fd-8127-391c3ce5c28e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:57.090661 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 975/1930] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:13:56 2022] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:57.092008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76421121-e86b-40fd-8127-391c3ce5c28e admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:57.132152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a72560-2373-4a6a-b969-ddc0d92b1aa5 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:57.207237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:57.228391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76421121-e86b-40fd-8127-391c3ce5c28e admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:57.235140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50fb72-ea23-475c-a34c-8038a7515eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:57.236916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50fb72-ea23-475c-a34c-8038a7515eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:57.237220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50fb72-ea23-475c-a34c-8038a7515eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:57.237505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50fb72-ea23-475c-a34c-8038a7515eeb admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:57.238270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50fb72-ea23-475c-a34c-8038a7515eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:57.240958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50fb72-ea23-475c-a34c-8038a7515eeb admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:57.277093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 976/1931] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:13:57 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:13:57.278553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156522e2-2cbf-412d-b205-9108e69028a4 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:57.278880 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156522e2-2cbf-412d-b205-9108e69028a4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:57.279132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156522e2-2cbf-412d-b205-9108e69028a4 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:57.281338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 977/1932] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:13:57.282269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156522e2-2cbf-412d-b205-9108e69028a4 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:57.284258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bae585-0cc2-4420-b96d-d60fd5b465aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:57.285126 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae585-0cc2-4420-b96d-d60fd5b465aa service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:57.285557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae585-0cc2-4420-b96d-d60fd5b465aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:57.296590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae585-0cc2-4420-b96d-d60fd5b465aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:57.305530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156522e2-2cbf-412d-b205-9108e69028a4 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:57.314491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-12bae585-0cc2-4420-b96d-d60fd5b465aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:57.315427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67f364-10aa-4b95-b900-acfd193d37e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:57.316142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67f364-10aa-4b95-b900-acfd193d37e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:57.316432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67f364-10aa-4b95-b900-acfd193d37e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:57.316757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67f364-10aa-4b95-b900-acfd193d37e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:57.317923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67f364-10aa-4b95-b900-acfd193d37e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:57.320289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67f364-10aa-4b95-b900-acfd193d37e9 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:57.350888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 978/1933] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:57.352873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f62904-ef0b-482e-a508-23e1a25e4a65 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:57.353181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f62904-ef0b-482e-a508-23e1a25e4a65 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:57.353468 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f62904-ef0b-482e-a508-23e1a25e4a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:57.377938 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a0f62904-ef0b-482e-a508-23e1a25e4a65 None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:57.379242 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a0f62904-ef0b-482e-a508-23e1a25e4a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:57.440187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bae585-0cc2-4420-b96d-d60fd5b465aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:57.443648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bae585-0cc2-4420-b96d-d60fd5b465aa service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:57.474189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 956/1934] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:57.488178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bae585-0cc2-4420-b96d-d60fd5b465aa service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:57.545938 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bae585-0cc2-4420-b96d-d60fd5b465aa service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:57.567430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cac6c-f3f7-433b-aac1-66800dda79ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:57.568561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cac6c-f3f7-433b-aac1-66800dda79ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:57.568649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cac6c-f3f7-433b-aac1-66800dda79ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:57.568903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cac6c-f3f7-433b-aac1-66800dda79ae admin admin] PATH_INFO: `/v3/projects/a3fe157b6391472eb931a7d8acdc1ed6/users/4ff95e2eda5f44b09700b0d0e177a649/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:57.607070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 979/1935] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:13:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:57.620507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cac6c-f3f7-433b-aac1-66800dda79ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fe157b6391472eb931a7d8acdc1ed6, user_id=4ff95e2eda5f44b09700b0d0e177a649, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:57.634053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cac6c-f3f7-433b-aac1-66800dda79ae admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:57.669351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 957/1936] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:57 2022] PUT /identity/v3/projects/a3fe157b6391472eb931a7d8acdc1ed6/users/4ff95e2eda5f44b09700b0d0e177a649/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:57.673629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f62904-ef0b-482e-a508-23e1a25e4a65 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:57.702118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f62904-ef0b-482e-a508-23e1a25e4a65 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:57.784276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cac6c-f3f7-433b-aac1-66800dda79ae admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:57.785448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9b2cac6c-f3f7-433b-aac1-66800dda79ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:57.823455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:57.858836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b0c28-b7bf-42fa-8e4f-1df892abdabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:57.859666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b0c28-b7bf-42fa-8e4f-1df892abdabc admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:57.860087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b0c28-b7bf-42fa-8e4f-1df892abdabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:57.860602 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b0c28-b7bf-42fa-8e4f-1df892abdabc admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:57.861453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b0c28-b7bf-42fa-8e4f-1df892abdabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:57.868622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b0c28-b7bf-42fa-8e4f-1df892abdabc admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:57.901817 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 980/1937] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:13:57.906932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b0c28-b7bf-42fa-8e4f-1df892abdabc admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:57.925253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cac6c-f3f7-433b-aac1-66800dda79ae admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:57.931320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b0c28-b7bf-42fa-8e4f-1df892abdabc admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:57.935405 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6b3cd-e5d3-4d27-8b59-e32fa3772144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:57.936621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6b3cd-e5d3-4d27-8b59-e32fa3772144 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:57.937455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6b3cd-e5d3-4d27-8b59-e32fa3772144 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:57.938409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6b3cd-e5d3-4d27-8b59-e32fa3772144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:57.941721 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-30e6b3cd-e5d3-4d27-8b59-e32fa3772144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:57.942815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857a5ab-3a52-4e4b-855c-4d8acde0589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:57.944789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857a5ab-3a52-4e4b-855c-4d8acde0589d admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:57.945639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857a5ab-3a52-4e4b-855c-4d8acde0589d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:57.945992 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857a5ab-3a52-4e4b-855c-4d8acde0589d admin admin] PATH_INFO: `/v3/projects/a3fe157b6391472eb931a7d8acdc1ed6/users/4ff95e2eda5f44b09700b0d0e177a649/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:57.949477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857a5ab-3a52-4e4b-855c-4d8acde0589d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fe157b6391472eb931a7d8acdc1ed6, user_id=4ff95e2eda5f44b09700b0d0e177a649, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:57.956195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857a5ab-3a52-4e4b-855c-4d8acde0589d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:57.998045 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 981/1938] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:13:57 2022] PUT /identity/v3/projects/a3fe157b6391472eb931a7d8acdc1ed6/users/4ff95e2eda5f44b09700b0d0e177a649/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:13:57.999176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857a5ab-3a52-4e4b-855c-4d8acde0589d admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:58.004439 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b857a5ab-3a52-4e4b-855c-4d8acde0589d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:58.110502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6b3cd-e5d3-4d27-8b59-e32fa3772144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:58.112634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6b3cd-e5d3-4d27-8b59-e32fa3772144 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:58.139417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 958/1939] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:58.145423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6a9b-aaa0-4486-ba6d-ded2a807786e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:58.145720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6a9b-aaa0-4486-ba6d-ded2a807786e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:58.146002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab6a9b-aaa0-4486-ba6d-ded2a807786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:58.180847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:58.218772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857a5ab-3a52-4e4b-855c-4d8acde0589d admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:58.227710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d8ab6a9b-aaa0-4486-ba6d-ded2a807786e None None] MFA Rules not processed for user `4ff95e2eda5f44b09700b0d0e177a649`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:13:58.229513 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d8ab6a9b-aaa0-4486-ba6d-ded2a807786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:58.234727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4a23-2dd8-4685-8ba4-4729aa02a47d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:58.235413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4a23-2dd8-4685-8ba4-4729aa02a47d service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:58.235704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4a23-2dd8-4685-8ba4-4729aa02a47d service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:58.235988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4a23-2dd8-4685-8ba4-4729aa02a47d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:58.250576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4a23-2dd8-4685-8ba4-4729aa02a47d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:58.252205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4a23-2dd8-4685-8ba4-4729aa02a47d service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:58.267910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 982/1940] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:58.378835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 959/1941] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:13:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:13:58.389902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4a23-2dd8-4685-8ba4-4729aa02a47d service nova] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:58.459499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4a23-2dd8-4685-8ba4-4729aa02a47d service nova] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:58.465828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847414c6-2fdb-463a-9b42-a2cc2836903a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:58.466877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847414c6-2fdb-463a-9b42-a2cc2836903a service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:58.467255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847414c6-2fdb-463a-9b42-a2cc2836903a service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:58.467602 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847414c6-2fdb-463a-9b42-a2cc2836903a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:58.480377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847414c6-2fdb-463a-9b42-a2cc2836903a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:58.481946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847414c6-2fdb-463a-9b42-a2cc2836903a service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:58.517623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 983/1942] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:13:58.528492 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab6a9b-aaa0-4486-ba6d-ded2a807786e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:58.547503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab6a9b-aaa0-4486-ba6d-ded2a807786e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:58.553233 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55446860-cc21-41e8-95f3-9a726fb94172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:58.555168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446860-cc21-41e8-95f3-9a726fb94172 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:58.555456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446860-cc21-41e8-95f3-9a726fb94172 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:58.555726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446860-cc21-41e8-95f3-9a726fb94172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:58.558868 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-55446860-cc21-41e8-95f3-9a726fb94172 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:13:58.689379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55446860-cc21-41e8-95f3-9a726fb94172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:58.693719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55446860-cc21-41e8-95f3-9a726fb94172 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:58.718700 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 960/1943] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:13:59.784615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847414c6-2fdb-463a-9b42-a2cc2836903a service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:13:59.794104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847414c6-2fdb-463a-9b42-a2cc2836903a service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:13:59.797715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037943d6-61e2-424c-bc6d-abc9ca852e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:13:59.798390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037943d6-61e2-424c-bc6d-abc9ca852e84 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:13:59.798685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037943d6-61e2-424c-bc6d-abc9ca852e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:13:59.798967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037943d6-61e2-424c-bc6d-abc9ca852e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:13:59.849133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:13:59.860411 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037943d6-61e2-424c-bc6d-abc9ca852e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:13:59.861916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037943d6-61e2-424c-bc6d-abc9ca852e84 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:13:59.872062 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 984/1944] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:13:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:00.111870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55446860-cc21-41e8-95f3-9a726fb94172 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:00.120945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55446860-cc21-41e8-95f3-9a726fb94172 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:00.125092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ac73b-7449-4d7d-9df3-a8fd607d4417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:00.125748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ac73b-7449-4d7d-9df3-a8fd607d4417 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:00.126039 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ac73b-7449-4d7d-9df3-a8fd607d4417 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:00.126356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ac73b-7449-4d7d-9df3-a8fd607d4417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:00.194862 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ac73b-7449-4d7d-9df3-a8fd607d4417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:00.196480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ac73b-7449-4d7d-9df3-a8fd607d4417 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:00.207087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 961/1945] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:02.043273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037943d6-61e2-424c-bc6d-abc9ca852e84 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:02.052193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037943d6-61e2-424c-bc6d-abc9ca852e84 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:02.056496 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c72c6e-f533-4adf-964e-a6b2c3f656ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:02.057157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c72c6e-f533-4adf-964e-a6b2c3f656ab service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:02.057473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c72c6e-f533-4adf-964e-a6b2c3f656ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:02.057756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c72c6e-f533-4adf-964e-a6b2c3f656ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:02.059588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-15c72c6e-f533-4adf-964e-a6b2c3f656ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:02.123517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c72c6e-f533-4adf-964e-a6b2c3f656ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:02.124966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c72c6e-f533-4adf-964e-a6b2c3f656ab service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:02.135076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 985/1946] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:07.069581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ac73b-7449-4d7d-9df3-a8fd607d4417 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:07.108154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:07.160276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ac73b-7449-4d7d-9df3-a8fd607d4417 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:07.180940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:07.181865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:07.185595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:07.186060 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] PATH_INFO: `/v3/users/8a44fd16c5a241de8f683dbb562afe34` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:07.188132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a44fd16c5a241de8f683dbb562afe34)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:07.190144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:07.277159 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a44fd16c5a241de8f683dbb562afe34'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:07.279488 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a44fd16c5a241de8f683dbb562afe34'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:07.280563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a44fd16c5a241de8f683dbb562afe34'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:07.292854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a44fd16c5a241de8f683dbb562afe34'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:07.309846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a44fd16c5a241de8f683dbb562afe34'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:07.330214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 962/1947] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:07 2022] DELETE /identity/v3/users/8a44fd16c5a241de8f683dbb562afe34 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:07.333637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b507010-0648-4cda-a885-9c58081bde8d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:07.334221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b507010-0648-4cda-a885-9c58081bde8d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:07.335138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b507010-0648-4cda-a885-9c58081bde8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:07.364071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5b507010-0648-4cda-a885-9c58081bde8d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:07.365297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5b507010-0648-4cda-a885-9c58081bde8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:07.427953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 986/1948] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:07.437771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:07.439238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:07.499713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91b226-7e04-455c-ab08-fd1f688e8a68 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:07.504781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c013a-46a9-442e-9e07-ede2c60438d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:07.505756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c013a-46a9-442e-9e07-ede2c60438d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:07.505756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c013a-46a9-442e-9e07-ede2c60438d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:07.505990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c013a-46a9-442e-9e07-ede2c60438d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:07.516748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c013a-46a9-442e-9e07-ede2c60438d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:07.518345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c013a-46a9-442e-9e07-ede2c60438d3 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:07.529442 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 963/1949] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:07.979269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b507010-0648-4cda-a885-9c58081bde8d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:07.981305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5b507010-0648-4cda-a885-9c58081bde8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:07.995505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b507010-0648-4cda-a885-9c58081bde8d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:08.001282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:08.002442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:08.002863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:08.003150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] PATH_INFO: `/v3/projects/d1d3caabba8647f096c3dce74b8c0aca` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:08.004501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d3caabba8647f096c3dce74b8c0aca)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:08.007300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:08.059931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d3caabba8647f096c3dce74b8c0aca', 'request_id': 'req-7ad24352-bf5d-4df1-acae-2f4e6b265e57'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.070615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d3caabba8647f096c3dce74b8c0aca', 'request_id': 'req-7ad24352-bf5d-4df1-acae-2f4e6b265e57'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.076820 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d3caabba8647f096c3dce74b8c0aca', 'request_id': 'req-7ad24352-bf5d-4df1-acae-2f4e6b265e57'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.091519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] The token cache is being invalidate because project d1d3caabba8647f096c3dce74b8c0aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:08.091932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.092571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.094439 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 987/1950] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:07 2022] DELETE /identity/v3/projects/d1d3caabba8647f096c3dce74b8c0aca => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:08.098327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c013a-46a9-442e-9e07-ede2c60438d3 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:08.108647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c013a-46a9-442e-9e07-ede2c60438d3 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:08.157386 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:08.174023 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a667e-9075-4d3d-af76-0c40feacdcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:08.175006 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a667e-9075-4d3d-af76-0c40feacdcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:08.175289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a667e-9075-4d3d-af76-0c40feacdcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:08.175564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a667e-9075-4d3d-af76-0c40feacdcb5 admin admin] PATH_INFO: `/v3/users/4ff95e2eda5f44b09700b0d0e177a649` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:08.176767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a667e-9075-4d3d-af76-0c40feacdcb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff95e2eda5f44b09700b0d0e177a649)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:08.179788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a667e-9075-4d3d-af76-0c40feacdcb5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:08.233449 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a75a667e-9075-4d3d-af76-0c40feacdcb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff95e2eda5f44b09700b0d0e177a649'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.234199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a75a667e-9075-4d3d-af76-0c40feacdcb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff95e2eda5f44b09700b0d0e177a649'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.234883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a75a667e-9075-4d3d-af76-0c40feacdcb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff95e2eda5f44b09700b0d0e177a649'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.243164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a75a667e-9075-4d3d-af76-0c40feacdcb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff95e2eda5f44b09700b0d0e177a649'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.255395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a75a667e-9075-4d3d-af76-0c40feacdcb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff95e2eda5f44b09700b0d0e177a649'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.268941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 964/1951] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:08 2022] DELETE /identity/v3/users/4ff95e2eda5f44b09700b0d0e177a649 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:08.555660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:08.557151 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:08.574640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad24352-bf5d-4df1-acae-2f4e6b265e57 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:08.585142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:08.646299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:08.647186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:08.647470 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:08.647745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] PATH_INFO: `/v3/projects/a3fe157b6391472eb931a7d8acdc1ed6` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:08.648964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fe157b6391472eb931a7d8acdc1ed6)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:08.650944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:08.698521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fe157b6391472eb931a7d8acdc1ed6', 'request_id': 'req-cd5e8f40-2b87-415d-a4ef-24004504c34c'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.705503 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fe157b6391472eb931a7d8acdc1ed6', 'request_id': 'req-cd5e8f40-2b87-415d-a4ef-24004504c34c'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.711581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fe157b6391472eb931a7d8acdc1ed6', 'request_id': 'req-cd5e8f40-2b87-415d-a4ef-24004504c34c'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.726658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] The token cache is being invalidate because project a3fe157b6391472eb931a7d8acdc1ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:08.727142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.727823 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cd5e8f40-2b87-415d-a4ef-24004504c34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:08.729921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 988/1952] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:08 2022] DELETE /identity/v3/projects/a3fe157b6391472eb931a7d8acdc1ed6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:08.734889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ceb86-6cb0-4eb6-9f49-a516ee20ae99 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:08.735186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ceb86-6cb0-4eb6-9f49-a516ee20ae99 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:08.735468 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ceb86-6cb0-4eb6-9f49-a516ee20ae99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:08.756247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a63ceb86-6cb0-4eb6-9f49-a516ee20ae99 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:08.757903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a63ceb86-6cb0-4eb6-9f49-a516ee20ae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:08.829324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 965/1953] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:08.837742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f3ff-e8c9-48fc-bc7e-b0bb6d9a9af3 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:08.838038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f3ff-e8c9-48fc-bc7e-b0bb6d9a9af3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:08.838347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f3ff-e8c9-48fc-bc7e-b0bb6d9a9af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:08.866201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4f44f3ff-e8c9-48fc-bc7e-b0bb6d9a9af3 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:08.867438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4f44f3ff-e8c9-48fc-bc7e-b0bb6d9a9af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:08.875516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 989/1954] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:08.879740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ceb86-6cb0-4eb6-9f49-a516ee20ae99 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:08.891426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ceb86-6cb0-4eb6-9f49-a516ee20ae99 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:08.896100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc28ed-6ac1-4089-8e4c-110913cfd889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:08.897391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc28ed-6ac1-4089-8e4c-110913cfd889 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:08.897682 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc28ed-6ac1-4089-8e4c-110913cfd889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:08.897962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc28ed-6ac1-4089-8e4c-110913cfd889 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:08.898733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc28ed-6ac1-4089-8e4c-110913cfd889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:08.899042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc28ed-6ac1-4089-8e4c-110913cfd889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:08.900784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc28ed-6ac1-4089-8e4c-110913cfd889 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:08.933456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 966/1955] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:08.938534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f3ff-e8c9-48fc-bc7e-b0bb6d9a9af3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:08.953301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f3ff-e8c9-48fc-bc7e-b0bb6d9a9af3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:08.958481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbf2d8-8687-4aca-84d3-fd2d7ac8c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:08.959681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbf2d8-8687-4aca-84d3-fd2d7ac8c6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:08.959937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbf2d8-8687-4aca-84d3-fd2d7ac8c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:08.960222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbf2d8-8687-4aca-84d3-fd2d7ac8c6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:08.960942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbf2d8-8687-4aca-84d3-fd2d7ac8c6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:08.962906 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbf2d8-8687-4aca-84d3-fd2d7ac8c6dd admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:08.995661 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 990/1956] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:08 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:14:08.997851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc28ed-6ac1-4089-8e4c-110913cfd889 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:09.009116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc28ed-6ac1-4089-8e4c-110913cfd889 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:09.059029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:09.070877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870e90-da91-45d6-af41-e2ed7114d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:09.071572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870e90-da91-45d6-af41-e2ed7114d1da admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.072257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870e90-da91-45d6-af41-e2ed7114d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.072550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa870e90-da91-45d6-af41-e2ed7114d1da admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.073253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870e90-da91-45d6-af41-e2ed7114d1da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:09.075281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa870e90-da91-45d6-af41-e2ed7114d1da admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:09.103546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 967/1957] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:08 2022] POST /identity/v3/users => generated 305 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:09.108129 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbf2d8-8687-4aca-84d3-fd2d7ac8c6dd admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:09.120168 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbf2d8-8687-4aca-84d3-fd2d7ac8c6dd admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:09.125649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34fce2-a047-4b4c-a68d-931d92e11a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:09.126361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fce2-a047-4b4c-a68d-931d92e11a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.126647 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fce2-a047-4b4c-a68d-931d92e11a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.126927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34fce2-a047-4b4c-a68d-931d92e11a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.127660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34fce2-a047-4b4c-a68d-931d92e11a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:09.129275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34fce2-a047-4b4c-a68d-931d92e11a1c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:09.140640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 991/1958] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:14:09.144682 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870e90-da91-45d6-af41-e2ed7114d1da admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:09.156560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa870e90-da91-45d6-af41-e2ed7114d1da admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:09.161524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27764a-356f-4f59-8b05-547883bc44ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:09.162215 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27764a-356f-4f59-8b05-547883bc44ce admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.163068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27764a-356f-4f59-8b05-547883bc44ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.163335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27764a-356f-4f59-8b05-547883bc44ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.164053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27764a-356f-4f59-8b05-547883bc44ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:09.165649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27764a-356f-4f59-8b05-547883bc44ce admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:09.176024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 968/1959] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:09.180382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34fce2-a047-4b4c-a68d-931d92e11a1c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:09.190554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34fce2-a047-4b4c-a68d-931d92e11a1c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:09.195677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254771fe-2ae4-48ef-9677-b61d9500c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:09.196585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254771fe-2ae4-48ef-9677-b61d9500c8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.196874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254771fe-2ae4-48ef-9677-b61d9500c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.197155 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254771fe-2ae4-48ef-9677-b61d9500c8ce admin admin] PATH_INFO: `/v3/projects/662a481e55f447928c7d6fd589f3a5ae/users/3255474a29d34dd1985ebdb80f92bfb2/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.213419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254771fe-2ae4-48ef-9677-b61d9500c8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=662a481e55f447928c7d6fd589f3a5ae, user_id=3255474a29d34dd1985ebdb80f92bfb2, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:09.216478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254771fe-2ae4-48ef-9677-b61d9500c8ce admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:09.232865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 992/1960] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:09 2022] PUT /identity/v3/projects/662a481e55f447928c7d6fd589f3a5ae/users/3255474a29d34dd1985ebdb80f92bfb2/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:09.244595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0131a2-30b7-4340-a940-fe48508f6bce None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.244815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0131a2-30b7-4340-a940-fe48508f6bce None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.245093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0131a2-30b7-4340-a940-fe48508f6bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.283715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8e0131a2-30b7-4340-a940-fe48508f6bce None None] MFA Rules not processed for user `3255474a29d34dd1985ebdb80f92bfb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:09.285479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8e0131a2-30b7-4340-a940-fe48508f6bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:09.361898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 969/1961] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:09.366872 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254771fe-2ae4-48ef-9677-b61d9500c8ce admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:09.409693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:09.439426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254771fe-2ae4-48ef-9677-b61d9500c8ce admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:09.444652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0374a8-1656-4467-ae92-4b412cb39f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:09.445324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0374a8-1656-4467-ae92-4b412cb39f27 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.445611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0374a8-1656-4467-ae92-4b412cb39f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.445890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0374a8-1656-4467-ae92-4b412cb39f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.446630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0374a8-1656-4467-ae92-4b412cb39f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:09.448533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0374a8-1656-4467-ae92-4b412cb39f27 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:09.476897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 993/1962] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:09 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:14:09.480900 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0131a2-30b7-4340-a940-fe48508f6bce None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:09.491850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0131a2-30b7-4340-a940-fe48508f6bce None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:09.548587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9430b-6134-4197-8419-3501c075f40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:09.549185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9430b-6134-4197-8419-3501c075f40f admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.549472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9430b-6134-4197-8419-3501c075f40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.549752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9430b-6134-4197-8419-3501c075f40f admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.550491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9430b-6134-4197-8419-3501c075f40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:09.552487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9430b-6134-4197-8419-3501c075f40f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:09.574138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 970/1963] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:09 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:09.578207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0374a8-1656-4467-ae92-4b412cb39f27 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:09.589028 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0374a8-1656-4467-ae92-4b412cb39f27 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:09.593955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c409-06a4-47b8-9dc4-6542783ebbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:09.594714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c409-06a4-47b8-9dc4-6542783ebbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.594992 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c409-06a4-47b8-9dc4-6542783ebbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.595264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c409-06a4-47b8-9dc4-6542783ebbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.596031 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9c409-06a4-47b8-9dc4-6542783ebbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:09.597651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9c409-06a4-47b8-9dc4-6542783ebbf8 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:09.613207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 994/1964] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:09.617923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9430b-6134-4197-8419-3501c075f40f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:09.632633 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9430b-6134-4197-8419-3501c075f40f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:09.637909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e49b1c-68df-443f-a7b1-5d82dccdd59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:09.638861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e49b1c-68df-443f-a7b1-5d82dccdd59b admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.639134 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e49b1c-68df-443f-a7b1-5d82dccdd59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.639409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e49b1c-68df-443f-a7b1-5d82dccdd59b admin admin] PATH_INFO: `/v3/projects/6893e9b4bc2b4d5ebf3f08d04bffd6bb/users/2c3ed8adc1a6463d88f8aaf87201e3fa/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.659552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e49b1c-68df-443f-a7b1-5d82dccdd59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6893e9b4bc2b4d5ebf3f08d04bffd6bb, user_id=2c3ed8adc1a6463d88f8aaf87201e3fa, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:09.662575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e49b1c-68df-443f-a7b1-5d82dccdd59b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:09.680390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 971/1965] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:09 2022] PUT /identity/v3/projects/6893e9b4bc2b4d5ebf3f08d04bffd6bb/users/2c3ed8adc1a6463d88f8aaf87201e3fa/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:09.684538 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c409-06a4-47b8-9dc4-6542783ebbf8 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:09.696625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c409-06a4-47b8-9dc4-6542783ebbf8 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:09.758446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c2fc5c-5029-4ace-80c2-afdef5f69f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:09.759129 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2fc5c-5029-4ace-80c2-afdef5f69f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.759416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2fc5c-5029-4ace-80c2-afdef5f69f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.759696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c2fc5c-5029-4ace-80c2-afdef5f69f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.760431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2fc5c-5029-4ace-80c2-afdef5f69f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:09.762031 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c2fc5c-5029-4ace-80c2-afdef5f69f31 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:09.771831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 995/1966] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:09.776104 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e49b1c-68df-443f-a7b1-5d82dccdd59b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:09.786490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e49b1c-68df-443f-a7b1-5d82dccdd59b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:09.791499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050feba-7d2d-4b28-9ce5-d6f39c79cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:09.792393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050feba-7d2d-4b28-9ce5-d6f39c79cd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.792682 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050feba-7d2d-4b28-9ce5-d6f39c79cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.792962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050feba-7d2d-4b28-9ce5-d6f39c79cd0f admin admin] PATH_INFO: `/v3/projects/6893e9b4bc2b4d5ebf3f08d04bffd6bb/users/2c3ed8adc1a6463d88f8aaf87201e3fa/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.794975 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050feba-7d2d-4b28-9ce5-d6f39c79cd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6893e9b4bc2b4d5ebf3f08d04bffd6bb, user_id=2c3ed8adc1a6463d88f8aaf87201e3fa, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:09.797613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050feba-7d2d-4b28-9ce5-d6f39c79cd0f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:09.809212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 972/1967] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:09 2022] PUT /identity/v3/projects/6893e9b4bc2b4d5ebf3f08d04bffd6bb/users/2c3ed8adc1a6463d88f8aaf87201e3fa/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:09.821020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57635244-2ff6-4413-a18b-82d4eb7b5300 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:09.821314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57635244-2ff6-4413-a18b-82d4eb7b5300 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:09.821597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57635244-2ff6-4413-a18b-82d4eb7b5300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:09.847861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-57635244-2ff6-4413-a18b-82d4eb7b5300 None None] MFA Rules not processed for user `2c3ed8adc1a6463d88f8aaf87201e3fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:09.849086 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-57635244-2ff6-4413-a18b-82d4eb7b5300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:09.930897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 996/1968] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:09.941355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050feba-7d2d-4b28-9ce5-d6f39c79cd0f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:09.943164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3050feba-7d2d-4b28-9ce5-d6f39c79cd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:09.959022 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:10.014123 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050feba-7d2d-4b28-9ce5-d6f39c79cd0f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:10.018470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca755d-75dc-4011-9e58-4149cc5f5001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:10.019201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca755d-75dc-4011-9e58-4149cc5f5001 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:10.019493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca755d-75dc-4011-9e58-4149cc5f5001 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:10.019774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca755d-75dc-4011-9e58-4149cc5f5001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:10.033602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca755d-75dc-4011-9e58-4149cc5f5001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:10.035563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca755d-75dc-4011-9e58-4149cc5f5001 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:10.055218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 973/1969] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:09 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:10.235194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57635244-2ff6-4413-a18b-82d4eb7b5300 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:10.245566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57635244-2ff6-4413-a18b-82d4eb7b5300 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:10.249257 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294c320-76d4-49d0-af5c-12ee86a30bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:10.249922 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294c320-76d4-49d0-af5c-12ee86a30bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:10.250243 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294c320-76d4-49d0-af5c-12ee86a30bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:10.250531 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294c320-76d4-49d0-af5c-12ee86a30bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:10.284144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:10.320334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294c320-76d4-49d0-af5c-12ee86a30bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:10.321787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294c320-76d4-49d0-af5c-12ee86a30bd6 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:10.331138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 997/1970] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:11.395895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca755d-75dc-4011-9e58-4149cc5f5001 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:11.398182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b2ca755d-75dc-4011-9e58-4149cc5f5001 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:11.508844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca755d-75dc-4011-9e58-4149cc5f5001 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:11.515469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:11.516967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:11.517526 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:11.517949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] PATH_INFO: `/v3/users/1fee086268424f24bdb8da3bd88cb08f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:11.519574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fee086268424f24bdb8da3bd88cb08f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:11.521861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:11.610250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fee086268424f24bdb8da3bd88cb08f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:11.611037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fee086268424f24bdb8da3bd88cb08f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:11.612082 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fee086268424f24bdb8da3bd88cb08f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:11.624802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fee086268424f24bdb8da3bd88cb08f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:11.655307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fee086268424f24bdb8da3bd88cb08f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:11.673587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 974/1971] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:11 2022] DELETE /identity/v3/users/1fee086268424f24bdb8da3bd88cb08f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:11.678508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cffa71-0fba-47ac-adc2-b0400a1bf2d3 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:11.679003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cffa71-0fba-47ac-adc2-b0400a1bf2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:11.679093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cffa71-0fba-47ac-adc2-b0400a1bf2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:11.699281 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-86cffa71-0fba-47ac-adc2-b0400a1bf2d3 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:11.701262 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-86cffa71-0fba-47ac-adc2-b0400a1bf2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:11.783619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 998/1972] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:11.795752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:11.797517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:11.856860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:11.885732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55fafe-9c1d-4380-9d66-21f88bbc964b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:11.892277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a795998-fa8e-4d27-b2cf-bd7478a22941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:11.892991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a795998-fa8e-4d27-b2cf-bd7478a22941 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:11.893259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a795998-fa8e-4d27-b2cf-bd7478a22941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:11.893990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a795998-fa8e-4d27-b2cf-bd7478a22941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:11.904524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a795998-fa8e-4d27-b2cf-bd7478a22941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:11.906261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a795998-fa8e-4d27-b2cf-bd7478a22941 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:11.918080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 975/1973] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:12.285340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cffa71-0fba-47ac-adc2-b0400a1bf2d3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:12.286866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-86cffa71-0fba-47ac-adc2-b0400a1bf2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:12.311934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cffa71-0fba-47ac-adc2-b0400a1bf2d3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:12.337119 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:12.339514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:12.341171 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:12.341823 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] PATH_INFO: `/v3/projects/de5020e45ded4d9bae1cd1abdb908b69` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:12.343486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5020e45ded4d9bae1cd1abdb908b69)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:12.345692 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:12.425822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5020e45ded4d9bae1cd1abdb908b69', 'request_id': 'req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:12.435696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5020e45ded4d9bae1cd1abdb908b69', 'request_id': 'req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:12.443163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5020e45ded4d9bae1cd1abdb908b69', 'request_id': 'req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:12.463957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] The token cache is being invalidate because project de5020e45ded4d9bae1cd1abdb908b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:12.464403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:12.465775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:12.469248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 999/1974] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:12 2022] DELETE /identity/v3/projects/de5020e45ded4d9bae1cd1abdb908b69 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:12.475645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a795998-fa8e-4d27-b2cf-bd7478a22941 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:12.498978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a795998-fa8e-4d27-b2cf-bd7478a22941 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:12.568810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:12.569701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:12.570015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:12.570337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] PATH_INFO: `/v3/users/4ca7efe16e934b24b8b8730247b10c4b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:12.571563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca7efe16e934b24b8b8730247b10c4b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:12.573496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:12.623299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca7efe16e934b24b8b8730247b10c4b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:12.624045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca7efe16e934b24b8b8730247b10c4b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:12.624695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca7efe16e934b24b8b8730247b10c4b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:12.631983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca7efe16e934b24b8b8730247b10c4b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:12.644190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca7efe16e934b24b8b8730247b10c4b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:12.657410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 976/1975] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:12 2022] DELETE /identity/v3/users/4ca7efe16e934b24b8b8730247b10c4b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:12.954435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:12.956104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:12.974966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5ba79-d9b7-4903-beff-4cc5cd1cc756 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:13.034625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:13.048027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:13.048924 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:13.049212 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:13.049497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] PATH_INFO: `/v3/projects/91aed36d1adf420e80cf232728f00c50` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:13.050859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=91aed36d1adf420e80cf232728f00c50)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:13.052775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:13.105971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91aed36d1adf420e80cf232728f00c50', 'request_id': 'req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.112304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91aed36d1adf420e80cf232728f00c50', 'request_id': 'req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.118109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91aed36d1adf420e80cf232728f00c50', 'request_id': 'req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.132210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] The token cache is being invalidate because project 91aed36d1adf420e80cf232728f00c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:13.132509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.133190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.134811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1000/1976] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:12 2022] DELETE /identity/v3/projects/91aed36d1adf420e80cf232728f00c50 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:13.138825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:13.140231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:13.154127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953b7a2-0535-4f49-af72-976b202660c6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:13.211589 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:13.220424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe37efe-e1d5-4d94-ac42-e98ad3af3b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:13.221318 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe37efe-e1d5-4d94-ac42-e98ad3af3b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:13.222360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe37efe-e1d5-4d94-ac42-e98ad3af3b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:13.222630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe37efe-e1d5-4d94-ac42-e98ad3af3b37 admin admin] PATH_INFO: `/v3/users/8017883444a84561ac34f76e98fac87a` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:13.224351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe37efe-e1d5-4d94-ac42-e98ad3af3b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8017883444a84561ac34f76e98fac87a)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:13.227196 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe37efe-e1d5-4d94-ac42-e98ad3af3b37 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:13.286345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dbe37efe-e1d5-4d94-ac42-e98ad3af3b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8017883444a84561ac34f76e98fac87a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.286995 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dbe37efe-e1d5-4d94-ac42-e98ad3af3b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8017883444a84561ac34f76e98fac87a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.288287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dbe37efe-e1d5-4d94-ac42-e98ad3af3b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8017883444a84561ac34f76e98fac87a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.295343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dbe37efe-e1d5-4d94-ac42-e98ad3af3b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8017883444a84561ac34f76e98fac87a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.308740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dbe37efe-e1d5-4d94-ac42-e98ad3af3b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8017883444a84561ac34f76e98fac87a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.320865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 977/1977] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:13 2022] DELETE /identity/v3/users/8017883444a84561ac34f76e98fac87a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:13.652756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:13.654374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:13.674474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ea4c-93fb-470b-ae8f-3bbf7f0d3a3f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:13.799027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:13.800067 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:13.800718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:13.800718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] PATH_INFO: `/v3/projects/d9475ecf565e49379c31dad5f12bb2ea` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:13.802007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9475ecf565e49379c31dad5f12bb2ea)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:13.804658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:13.902642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9475ecf565e49379c31dad5f12bb2ea', 'request_id': 'req-55f47535-bb9c-400f-86ab-6556e3791bbb'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.910055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9475ecf565e49379c31dad5f12bb2ea', 'request_id': 'req-55f47535-bb9c-400f-86ab-6556e3791bbb'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.919488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9475ecf565e49379c31dad5f12bb2ea', 'request_id': 'req-55f47535-bb9c-400f-86ab-6556e3791bbb'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.936276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] The token cache is being invalidate because project d9475ecf565e49379c31dad5f12bb2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:13.936469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.937126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-55f47535-bb9c-400f-86ab-6556e3791bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:13.938822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1001/1978] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:13 2022] DELETE /identity/v3/projects/d9475ecf565e49379c31dad5f12bb2ea => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:13.944453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b63ed-8816-4676-a35b-c6b277981622 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:13.945107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b63ed-8816-4676-a35b-c6b277981622 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:13.945107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b63ed-8816-4676-a35b-c6b277981622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:13.966655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f68b63ed-8816-4676-a35b-c6b277981622 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:13.968172 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f68b63ed-8816-4676-a35b-c6b277981622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:14.046322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 978/1979] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:14.055778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f748f-f9e4-4b34-ab9d-1a26b47bc851 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.056270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f748f-f9e4-4b34-ab9d-1a26b47bc851 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.056460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f748f-f9e4-4b34-ab9d-1a26b47bc851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.077995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-551f748f-f9e4-4b34-ab9d-1a26b47bc851 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:14.079321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-551f748f-f9e4-4b34-ab9d-1a26b47bc851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:14.087470 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1002/1980] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:14.095375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b63ed-8816-4676-a35b-c6b277981622 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:14.112984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b63ed-8816-4676-a35b-c6b277981622 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:14.130353 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a188f-bbb8-4c7a-8bd1-98b24a0d6927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:14.134555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a188f-bbb8-4c7a-8bd1-98b24a0d6927 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.135119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a188f-bbb8-4c7a-8bd1-98b24a0d6927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.136526 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a188f-bbb8-4c7a-8bd1-98b24a0d6927 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.138147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a188f-bbb8-4c7a-8bd1-98b24a0d6927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:14.142770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a188f-bbb8-4c7a-8bd1-98b24a0d6927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:14.145453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a188f-bbb8-4c7a-8bd1-98b24a0d6927 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:14.167193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 979/1981] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:14.168595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f748f-f9e4-4b34-ab9d-1a26b47bc851 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:14.180155 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f748f-f9e4-4b34-ab9d-1a26b47bc851 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:14.187797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4487b0-dc15-47d5-8ab6-985a57005eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:14.187797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4487b0-dc15-47d5-8ab6-985a57005eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.187797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4487b0-dc15-47d5-8ab6-985a57005eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.188055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4487b0-dc15-47d5-8ab6-985a57005eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.189942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4487b0-dc15-47d5-8ab6-985a57005eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:14.192216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4487b0-dc15-47d5-8ab6-985a57005eaf admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:14.202498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:14.265963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1003/1982] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:14 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:14.270735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a188f-bbb8-4c7a-8bd1-98b24a0d6927 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:14.285425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a188f-bbb8-4c7a-8bd1-98b24a0d6927 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:14.348273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4487b0-dc15-47d5-8ab6-985a57005eaf admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:14.350572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-de4487b0-dc15-47d5-8ab6-985a57005eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:14.370625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92479d-af4f-4de0-9513-2dea3f9369b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:14.371658 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92479d-af4f-4de0-9513-2dea3f9369b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.372105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92479d-af4f-4de0-9513-2dea3f9369b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.372535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92479d-af4f-4de0-9513-2dea3f9369b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.373558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92479d-af4f-4de0-9513-2dea3f9369b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:14.375787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92479d-af4f-4de0-9513-2dea3f9369b5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:14.386006 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:14.400587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 980/1983] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:14 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:14.403923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92479d-af4f-4de0-9513-2dea3f9369b5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:14.415479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92479d-af4f-4de0-9513-2dea3f9369b5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:14.418728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4487b0-dc15-47d5-8ab6-985a57005eaf admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:14.421119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3e25e-76b9-4948-b596-965edc2da04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:14.421814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3e25e-76b9-4948-b596-965edc2da04b admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.422102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3e25e-76b9-4948-b596-965edc2da04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.422429 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3e25e-76b9-4948-b596-965edc2da04b admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.423171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3e25e-76b9-4948-b596-965edc2da04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:14.424994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3e25e-76b9-4948-b596-965edc2da04b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:14.426109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd49cd7-e7ae-43a2-88cb-c79050736ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:14.428558 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd49cd7-e7ae-43a2-88cb-c79050736ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.429430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd49cd7-e7ae-43a2-88cb-c79050736ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.430396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd49cd7-e7ae-43a2-88cb-c79050736ad7 admin admin] PATH_INFO: `/v3/users/e0a7a9d46e2544819a2643b4ae1492d8` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.432726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd49cd7-e7ae-43a2-88cb-c79050736ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a7a9d46e2544819a2643b4ae1492d8)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:14.437235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd49cd7-e7ae-43a2-88cb-c79050736ad7 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:14.438225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 981/1984] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:14:14.445233 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3e25e-76b9-4948-b596-965edc2da04b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:14.468545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3e25e-76b9-4948-b596-965edc2da04b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:14.475152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224be28c-8d57-4f91-aed5-1da90237d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:14.475871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224be28c-8d57-4f91-aed5-1da90237d7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.476322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224be28c-8d57-4f91-aed5-1da90237d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.476623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224be28c-8d57-4f91-aed5-1da90237d7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.477444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224be28c-8d57-4f91-aed5-1da90237d7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:14.479136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224be28c-8d57-4f91-aed5-1da90237d7e8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:14.492010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 982/1985] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:14:14.495818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224be28c-8d57-4f91-aed5-1da90237d7e8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:14.503655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1dd49cd7-e7ae-43a2-88cb-c79050736ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a7a9d46e2544819a2643b4ae1492d8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:14.504408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1dd49cd7-e7ae-43a2-88cb-c79050736ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a7a9d46e2544819a2643b4ae1492d8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:14.505305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1dd49cd7-e7ae-43a2-88cb-c79050736ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a7a9d46e2544819a2643b4ae1492d8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:14.506897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224be28c-8d57-4f91-aed5-1da90237d7e8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:14.511694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed91769-2175-417e-979b-b2758f0c67f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:14.512600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed91769-2175-417e-979b-b2758f0c67f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.512916 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed91769-2175-417e-979b-b2758f0c67f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.513196 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed91769-2175-417e-979b-b2758f0c67f4 admin admin] PATH_INFO: `/v3/projects/3d2d3098c7c34459ad0bd622c4b183f7/users/92f17a71dcdc4663a51ef8ca291441f3/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.515185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1dd49cd7-e7ae-43a2-88cb-c79050736ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a7a9d46e2544819a2643b4ae1492d8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:14.523801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1dd49cd7-e7ae-43a2-88cb-c79050736ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a7a9d46e2544819a2643b4ae1492d8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:14.531434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed91769-2175-417e-979b-b2758f0c67f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2d3098c7c34459ad0bd622c4b183f7, user_id=92f17a71dcdc4663a51ef8ca291441f3, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:14.534250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed91769-2175-417e-979b-b2758f0c67f4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:14.549616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1004/1986] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:14 2022] DELETE /identity/v3/users/e0a7a9d46e2544819a2643b4ae1492d8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:14.551288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2495e5-b4d1-4031-ba8d-93697e14482c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.551585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2495e5-b4d1-4031-ba8d-93697e14482c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.552022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2495e5-b4d1-4031-ba8d-93697e14482c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.555835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 983/1987] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:14 2022] PUT /identity/v3/projects/3d2d3098c7c34459ad0bd622c4b183f7/users/92f17a71dcdc4663a51ef8ca291441f3/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:14.566047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af175e-4868-46a5-82f9-bd7e6cee0451 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.566381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af175e-4868-46a5-82f9-bd7e6cee0451 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.566707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64af175e-4868-46a5-82f9-bd7e6cee0451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.573066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-cd2495e5-b4d1-4031-ba8d-93697e14482c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:14.574333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cd2495e5-b4d1-4031-ba8d-93697e14482c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:14.593172 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-64af175e-4868-46a5-82f9-bd7e6cee0451 None None] MFA Rules not processed for user `92f17a71dcdc4663a51ef8ca291441f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:14.594465 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-64af175e-4868-46a5-82f9-bd7e6cee0451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:14.635903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1005/1988] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:14:14.645985 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2495e5-b4d1-4031-ba8d-93697e14482c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:14.647426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cd2495e5-b4d1-4031-ba8d-93697e14482c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:14.653658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:14.662839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 984/1989] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:14:14.673534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af175e-4868-46a5-82f9-bd7e6cee0451 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:14.674968 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-64af175e-4868-46a5-82f9-bd7e6cee0451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:14.709474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2495e5-b4d1-4031-ba8d-93697e14482c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:14.713383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78855ab-54f8-4199-b192-216081848cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:14.714037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78855ab-54f8-4199-b192-216081848cda service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.714354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78855ab-54f8-4199-b192-216081848cda service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.714633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78855ab-54f8-4199-b192-216081848cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.724210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78855ab-54f8-4199-b192-216081848cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:14.726554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78855ab-54f8-4199-b192-216081848cda service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:14.733425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64af175e-4868-46a5-82f9-bd7e6cee0451 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:14.737229 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1006/1990] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:14:14.737454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a47dd-41da-4b6b-b9cd-e7382be69907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:14.738122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a47dd-41da-4b6b-b9cd-e7382be69907 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:14.738453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a47dd-41da-4b6b-b9cd-e7382be69907 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:14.738738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a47dd-41da-4b6b-b9cd-e7382be69907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:14.752534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a47dd-41da-4b6b-b9cd-e7382be69907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:14.753901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a47dd-41da-4b6b-b9cd-e7382be69907 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:14.776501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 985/1991] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:14:15.164206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78855ab-54f8-4199-b192-216081848cda service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:15.165723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c78855ab-54f8-4199-b192-216081848cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:15.199330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78855ab-54f8-4199-b192-216081848cda service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:15.212266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:15.213751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:15.214422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:15.214885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] PATH_INFO: `/v3/projects/62ace54e31a4439f822f7bd69a6b3fda` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:15.216207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ace54e31a4439f822f7bd69a6b3fda)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:15.218324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:15.280890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ace54e31a4439f822f7bd69a6b3fda', 'request_id': 'req-98ba2adb-737a-41aa-8a1a-661731eeb2b8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.288088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ace54e31a4439f822f7bd69a6b3fda', 'request_id': 'req-98ba2adb-737a-41aa-8a1a-661731eeb2b8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.295021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ace54e31a4439f822f7bd69a6b3fda', 'request_id': 'req-98ba2adb-737a-41aa-8a1a-661731eeb2b8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.311807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] The token cache is being invalidate because project 62ace54e31a4439f822f7bd69a6b3fda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:15.312103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.312750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.314333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1007/1992] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:15 2022] DELETE /identity/v3/projects/62ace54e31a4439f822f7bd69a6b3fda => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:15.319178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a47dd-41da-4b6b-b9cd-e7382be69907 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:15.335018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a47dd-41da-4b6b-b9cd-e7382be69907 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:15.377113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:15.406046 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a240-bee7-4aa0-b517-26806fa2c107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:15.407280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a240-bee7-4aa0-b517-26806fa2c107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:15.407702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a240-bee7-4aa0-b517-26806fa2c107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:15.408126 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a240-bee7-4aa0-b517-26806fa2c107 admin admin] PATH_INFO: `/v3/users/d8ea32456ddd47c291ff73b93150ed7e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:15.409616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304a240-bee7-4aa0-b517-26806fa2c107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ea32456ddd47c291ff73b93150ed7e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:15.411782 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304a240-bee7-4aa0-b517-26806fa2c107 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:15.464880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1304a240-bee7-4aa0-b517-26806fa2c107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ea32456ddd47c291ff73b93150ed7e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.465542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1304a240-bee7-4aa0-b517-26806fa2c107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ea32456ddd47c291ff73b93150ed7e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.466177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1304a240-bee7-4aa0-b517-26806fa2c107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ea32456ddd47c291ff73b93150ed7e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.473832 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1304a240-bee7-4aa0-b517-26806fa2c107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ea32456ddd47c291ff73b93150ed7e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.488325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1304a240-bee7-4aa0-b517-26806fa2c107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ea32456ddd47c291ff73b93150ed7e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.501985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 986/1993] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:15 2022] DELETE /identity/v3/users/d8ea32456ddd47c291ff73b93150ed7e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:15.834531 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:15.835981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:15.855469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba2adb-737a-41aa-8a1a-661731eeb2b8 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:15.921369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:15.922295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:15.922589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:15.922868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] PATH_INFO: `/v3/projects/e8bc79059afb414faf361f7745677979` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:15.924181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8bc79059afb414faf361f7745677979)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:15.926205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:15.962336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:15.976716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bc79059afb414faf361f7745677979', 'request_id': 'req-e14be29c-dda9-488f-b026-26e08c6539bd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.983238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bc79059afb414faf361f7745677979', 'request_id': 'req-e14be29c-dda9-488f-b026-26e08c6539bd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:15.988816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bc79059afb414faf361f7745677979', 'request_id': 'req-e14be29c-dda9-488f-b026-26e08c6539bd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:16.002697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] The token cache is being invalidate because project e8bc79059afb414faf361f7745677979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:16.002994 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:16.003630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e14be29c-dda9-488f-b026-26e08c6539bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:16.005196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1008/1994] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:15 2022] DELETE /identity/v3/projects/e8bc79059afb414faf361f7745677979 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:16.011120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304fc7-9fd9-4eba-bc80-8de840f2bd93 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.011446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304fc7-9fd9-4eba-bc80-8de840f2bd93 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.011730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87304fc7-9fd9-4eba-bc80-8de840f2bd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.030018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-87304fc7-9fd9-4eba-bc80-8de840f2bd93 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:16.031346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-87304fc7-9fd9-4eba-bc80-8de840f2bd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:16.093492 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 987/1995] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:16.103103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371408d-18aa-4a60-b7fa-2183a18a0e67 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.103428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371408d-18aa-4a60-b7fa-2183a18a0e67 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.103737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371408d-18aa-4a60-b7fa-2183a18a0e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.125275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-7371408d-18aa-4a60-b7fa-2183a18a0e67 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:16.126705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7371408d-18aa-4a60-b7fa-2183a18a0e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:16.135812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1009/1996] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:14:16.140119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87304fc7-9fd9-4eba-bc80-8de840f2bd93 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:16.150033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87304fc7-9fd9-4eba-bc80-8de840f2bd93 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:16.154756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c63488-7c6e-46d8-a883-8df2873ec77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:16.155421 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63488-7c6e-46d8-a883-8df2873ec77a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.155697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63488-7c6e-46d8-a883-8df2873ec77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.155972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c63488-7c6e-46d8-a883-8df2873ec77a admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.156703 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c63488-7c6e-46d8-a883-8df2873ec77a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:16.157010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c63488-7c6e-46d8-a883-8df2873ec77a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:16.158642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c63488-7c6e-46d8-a883-8df2873ec77a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:16.174895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 988/1997] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:16.175893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371408d-18aa-4a60-b7fa-2183a18a0e67 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:16.187571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371408d-18aa-4a60-b7fa-2183a18a0e67 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:16.192701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8412950-ba70-4e9e-896b-f556b796b2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:16.193428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412950-ba70-4e9e-896b-f556b796b2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.193785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412950-ba70-4e9e-896b-f556b796b2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.194312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8412950-ba70-4e9e-896b-f556b796b2d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.195518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8412950-ba70-4e9e-896b-f556b796b2d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:16.197463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8412950-ba70-4e9e-896b-f556b796b2d8 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:16.237886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1010/1998] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:16 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:14:16.242549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c63488-7c6e-46d8-a883-8df2873ec77a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:16.256557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c63488-7c6e-46d8-a883-8df2873ec77a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:16.324816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:16.342798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff37ca-5704-4b0b-9eba-e7d1aab4fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:16.343650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff37ca-5704-4b0b-9eba-e7d1aab4fc50 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.343939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff37ca-5704-4b0b-9eba-e7d1aab4fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.344215 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff37ca-5704-4b0b-9eba-e7d1aab4fc50 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.344931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff37ca-5704-4b0b-9eba-e7d1aab4fc50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:16.346924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff37ca-5704-4b0b-9eba-e7d1aab4fc50 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:16.383235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 989/1999] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:16 2022] POST /identity/v3/users => generated 285 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:16.388008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8412950-ba70-4e9e-896b-f556b796b2d8 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:16.405611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8412950-ba70-4e9e-896b-f556b796b2d8 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:16.413108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c301f3-f991-4b8e-8bc5-cf1785a8e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:16.414018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c301f3-f991-4b8e-8bc5-cf1785a8e926 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.414359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c301f3-f991-4b8e-8bc5-cf1785a8e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.414642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c301f3-f991-4b8e-8bc5-cf1785a8e926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.415389 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c301f3-f991-4b8e-8bc5-cf1785a8e926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:16.416991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c301f3-f991-4b8e-8bc5-cf1785a8e926 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:16.429112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1011/2000] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:16.433404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff37ca-5704-4b0b-9eba-e7d1aab4fc50 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:16.443961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff37ca-5704-4b0b-9eba-e7d1aab4fc50 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:16.449108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8cb73-dcd1-4d67-8fb2-95eef952fc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:16.449794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8cb73-dcd1-4d67-8fb2-95eef952fc31 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.450086 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8cb73-dcd1-4d67-8fb2-95eef952fc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.450567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8cb73-dcd1-4d67-8fb2-95eef952fc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.451269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8cb73-dcd1-4d67-8fb2-95eef952fc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:16.452934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8cb73-dcd1-4d67-8fb2-95eef952fc31 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:16.466186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 990/2001] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:16.468771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c301f3-f991-4b8e-8bc5-cf1785a8e926 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:16.479544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c301f3-f991-4b8e-8bc5-cf1785a8e926 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:16.484115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129a86d-c4a3-4436-81f7-8bb504d83292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:16.484993 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a86d-c4a3-4436-81f7-8bb504d83292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.485286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a86d-c4a3-4436-81f7-8bb504d83292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.485563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a86d-c4a3-4436-81f7-8bb504d83292 admin admin] PATH_INFO: `/v3/projects/b9c82ebe6e3d4bb99ad71a8517ab291d/users/279b90141300433b811e8a5755112d41/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.499803 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129a86d-c4a3-4436-81f7-8bb504d83292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c82ebe6e3d4bb99ad71a8517ab291d, user_id=279b90141300433b811e8a5755112d41, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:16.502415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129a86d-c4a3-4436-81f7-8bb504d83292 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:16.515675 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1012/2002] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:16 2022] PUT /identity/v3/projects/b9c82ebe6e3d4bb99ad71a8517ab291d/users/279b90141300433b811e8a5755112d41/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:16.526579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cdd55-be74-412f-9c83-c68e4d7233ca None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.526877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cdd55-be74-412f-9c83-c68e4d7233ca None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.527161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cdd55-be74-412f-9c83-c68e4d7233ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.553971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-473cdd55-be74-412f-9c83-c68e4d7233ca None None] MFA Rules not processed for user `279b90141300433b811e8a5755112d41`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:16.555304 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-473cdd55-be74-412f-9c83-c68e4d7233ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:16.622130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 991/2003] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:14:16.626659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129a86d-c4a3-4436-81f7-8bb504d83292 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:16.689560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129a86d-c4a3-4436-81f7-8bb504d83292 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:16.699816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6da2d-51c1-4a6c-b332-49a116014645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:16.700961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6da2d-51c1-4a6c-b332-49a116014645 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.701671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6da2d-51c1-4a6c-b332-49a116014645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.702096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6da2d-51c1-4a6c-b332-49a116014645 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.702964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6da2d-51c1-4a6c-b332-49a116014645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:16.705301 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6da2d-51c1-4a6c-b332-49a116014645 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:16.733721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1013/2004] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:16 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:14:16.737445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cdd55-be74-412f-9c83-c68e4d7233ca None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:16.748415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cdd55-be74-412f-9c83-c68e4d7233ca None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:16.806778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b0142-8f71-4039-a520-089a70523bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:16.807468 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0142-8f71-4039-a520-089a70523bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.807774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0142-8f71-4039-a520-089a70523bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.808059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0142-8f71-4039-a520-089a70523bbc admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.808764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b0142-8f71-4039-a520-089a70523bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:16.810762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b0142-8f71-4039-a520-089a70523bbc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:16.834749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 992/2005] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:16 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:16.836511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6da2d-51c1-4a6c-b332-49a116014645 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:16.848180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6da2d-51c1-4a6c-b332-49a116014645 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:16.853555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c962b-c337-43e4-8cd4-801215a6e9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:16.854511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c962b-c337-43e4-8cd4-801215a6e9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.854807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c962b-c337-43e4-8cd4-801215a6e9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.855104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c962b-c337-43e4-8cd4-801215a6e9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.855844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c962b-c337-43e4-8cd4-801215a6e9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:16.857469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c962b-c337-43e4-8cd4-801215a6e9bc admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:16.869064 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1014/2006] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:16.873491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b0142-8f71-4039-a520-089a70523bbc admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:16.885757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b0142-8f71-4039-a520-089a70523bbc admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:16.890810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a4ce5-80a7-48f9-92a8-9fc6db369efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:16.891708 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a4ce5-80a7-48f9-92a8-9fc6db369efd admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:16.891993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a4ce5-80a7-48f9-92a8-9fc6db369efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:16.892269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a4ce5-80a7-48f9-92a8-9fc6db369efd admin admin] PATH_INFO: `/v3/projects/e56ce7b5f6c44abb9b3fcefeb3eb53a7/users/f71c9c0f7ca94142b24c43bb506eb37e/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:16.911564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a4ce5-80a7-48f9-92a8-9fc6db369efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56ce7b5f6c44abb9b3fcefeb3eb53a7, user_id=f71c9c0f7ca94142b24c43bb506eb37e, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:16.914259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a4ce5-80a7-48f9-92a8-9fc6db369efd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:16.930469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 993/2007] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:16 2022] PUT /identity/v3/projects/e56ce7b5f6c44abb9b3fcefeb3eb53a7/users/f71c9c0f7ca94142b24c43bb506eb37e/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:16.935061 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c962b-c337-43e4-8cd4-801215a6e9bc admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:16.947025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c962b-c337-43e4-8cd4-801215a6e9bc admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:16.977472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:17.011420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caacfca-effa-4d94-aa8f-73f51a45fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:17.012316 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caacfca-effa-4d94-aa8f-73f51a45fec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:17.012460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caacfca-effa-4d94-aa8f-73f51a45fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:17.012676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caacfca-effa-4d94-aa8f-73f51a45fec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:17.013413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caacfca-effa-4d94-aa8f-73f51a45fec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:17.015054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caacfca-effa-4d94-aa8f-73f51a45fec5 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:17.026150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1015/2008] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:17.030379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a4ce5-80a7-48f9-92a8-9fc6db369efd admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:17.045542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a4ce5-80a7-48f9-92a8-9fc6db369efd admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:17.050755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e00a2-37f5-44f6-94b5-699f271e9f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:17.051588 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e00a2-37f5-44f6-94b5-699f271e9f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:17.051872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e00a2-37f5-44f6-94b5-699f271e9f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:17.052148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e00a2-37f5-44f6-94b5-699f271e9f4e admin admin] PATH_INFO: `/v3/projects/e56ce7b5f6c44abb9b3fcefeb3eb53a7/users/f71c9c0f7ca94142b24c43bb506eb37e/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:17.054721 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e00a2-37f5-44f6-94b5-699f271e9f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56ce7b5f6c44abb9b3fcefeb3eb53a7, user_id=f71c9c0f7ca94142b24c43bb506eb37e, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:17.057569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e00a2-37f5-44f6-94b5-699f271e9f4e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:17.067948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 994/2009] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:17 2022] PUT /identity/v3/projects/e56ce7b5f6c44abb9b3fcefeb3eb53a7/users/f71c9c0f7ca94142b24c43bb506eb37e/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:17.078666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c95d1e-b63f-49af-86f6-e40190102b79 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:17.078962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c95d1e-b63f-49af-86f6-e40190102b79 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:17.079248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c95d1e-b63f-49af-86f6-e40190102b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:17.106921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d4c95d1e-b63f-49af-86f6-e40190102b79 None None] MFA Rules not processed for user `f71c9c0f7ca94142b24c43bb506eb37e`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:17.108303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d4c95d1e-b63f-49af-86f6-e40190102b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:17.186047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1016/2010] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:17.202553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e00a2-37f5-44f6-94b5-699f271e9f4e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:17.204340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3e0e00a2-37f5-44f6-94b5-699f271e9f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:17.215690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:17.273206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e00a2-37f5-44f6-94b5-699f271e9f4e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:17.279258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00c598-443f-4dd9-97a9-07d38de9dfb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:17.279899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00c598-443f-4dd9-97a9-07d38de9dfb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:17.280235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00c598-443f-4dd9-97a9-07d38de9dfb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:17.280521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00c598-443f-4dd9-97a9-07d38de9dfb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:17.291505 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00c598-443f-4dd9-97a9-07d38de9dfb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:17.292975 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00c598-443f-4dd9-97a9-07d38de9dfb4 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:17.304532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 995/2011] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:18.723833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c95d1e-b63f-49af-86f6-e40190102b79 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:18.789904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c95d1e-b63f-49af-86f6-e40190102b79 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:18.794746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:18.795638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:18.795926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:18.796209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] PATH_INFO: `/v3/users/279b90141300433b811e8a5755112d41` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:18.797441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=279b90141300433b811e8a5755112d41)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:18.799442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:18.848718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '279b90141300433b811e8a5755112d41'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:18.849415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '279b90141300433b811e8a5755112d41'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:18.850056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '279b90141300433b811e8a5755112d41'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:18.855952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:18.858364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '279b90141300433b811e8a5755112d41'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:18.870947 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '279b90141300433b811e8a5755112d41'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:18.891112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1017/2012] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:18 2022] DELETE /identity/v3/users/279b90141300433b811e8a5755112d41 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:18.895657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc63e-fd93-42c6-8dc8-a4bbf9d6d836 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:18.896119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc63e-fd93-42c6-8dc8-a4bbf9d6d836 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:18.896302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc63e-fd93-42c6-8dc8-a4bbf9d6d836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:18.913869 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3f0bc63e-fd93-42c6-8dc8-a4bbf9d6d836 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:18.915120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3f0bc63e-fd93-42c6-8dc8-a4bbf9d6d836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:18.972968 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 996/2013] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:18.983159 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:18.984610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:19.048140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eea585-5d08-4af0-aa4b-a8d39ce9a51b admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:19.051899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df33c6-136f-4807-9ead-fa950f22d4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:19.053184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df33c6-136f-4807-9ead-fa950f22d4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:19.053475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df33c6-136f-4807-9ead-fa950f22d4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:19.053757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df33c6-136f-4807-9ead-fa950f22d4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:19.063436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df33c6-136f-4807-9ead-fa950f22d4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:19.064926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df33c6-136f-4807-9ead-fa950f22d4c2 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:19.075188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1018/2014] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:19.359579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc63e-fd93-42c6-8dc8-a4bbf9d6d836 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:19.363264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3f0bc63e-fd93-42c6-8dc8-a4bbf9d6d836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:19.377463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc63e-fd93-42c6-8dc8-a4bbf9d6d836 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:19.382434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:19.383302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:19.383583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:19.383853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] PATH_INFO: `/v3/projects/b9c82ebe6e3d4bb99ad71a8517ab291d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:19.385035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c82ebe6e3d4bb99ad71a8517ab291d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:19.387008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:19.437527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c82ebe6e3d4bb99ad71a8517ab291d', 'request_id': 'req-60556777-5619-4d81-9d38-617d0dbc4a0f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:19.443266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c82ebe6e3d4bb99ad71a8517ab291d', 'request_id': 'req-60556777-5619-4d81-9d38-617d0dbc4a0f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:19.451728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c82ebe6e3d4bb99ad71a8517ab291d', 'request_id': 'req-60556777-5619-4d81-9d38-617d0dbc4a0f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:19.463689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] The token cache is being invalidate because project b9c82ebe6e3d4bb99ad71a8517ab291d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:19.463981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:19.464624 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:19.466199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 997/2015] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:19 2022] DELETE /identity/v3/projects/b9c82ebe6e3d4bb99ad71a8517ab291d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:19.470306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df33c6-136f-4807-9ead-fa950f22d4c2 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:19.482080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df33c6-136f-4807-9ead-fa950f22d4c2 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:19.543876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ebd6-8682-461e-b265-7197ac82b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:19.544803 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ebd6-8682-461e-b265-7197ac82b819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:19.545080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ebd6-8682-461e-b265-7197ac82b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:19.545361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ebd6-8682-461e-b265-7197ac82b819 admin admin] PATH_INFO: `/v3/users/f71c9c0f7ca94142b24c43bb506eb37e` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:19.546886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467ebd6-8682-461e-b265-7197ac82b819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71c9c0f7ca94142b24c43bb506eb37e)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:19.549122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467ebd6-8682-461e-b265-7197ac82b819 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:19.600211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8467ebd6-8682-461e-b265-7197ac82b819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71c9c0f7ca94142b24c43bb506eb37e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:19.600918 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8467ebd6-8682-461e-b265-7197ac82b819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71c9c0f7ca94142b24c43bb506eb37e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:19.601568 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8467ebd6-8682-461e-b265-7197ac82b819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71c9c0f7ca94142b24c43bb506eb37e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:19.609852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8467ebd6-8682-461e-b265-7197ac82b819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71c9c0f7ca94142b24c43bb506eb37e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:19.619139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8467ebd6-8682-461e-b265-7197ac82b819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71c9c0f7ca94142b24c43bb506eb37e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:19.630181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:19.640532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1019/2016] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:19 2022] DELETE /identity/v3/users/f71c9c0f7ca94142b24c43bb506eb37e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:20.284335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:20.286018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:20.320727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60556777-5619-4d81-9d38-617d0dbc4a0f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:20.358003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:20.398953 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:20.402112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:20.402619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:20.402921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] PATH_INFO: `/v3/projects/e56ce7b5f6c44abb9b3fcefeb3eb53a7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:20.404257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56ce7b5f6c44abb9b3fcefeb3eb53a7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:20.406213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:20.461708 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56ce7b5f6c44abb9b3fcefeb3eb53a7', 'request_id': 'req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:20.467829 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56ce7b5f6c44abb9b3fcefeb3eb53a7', 'request_id': 'req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:20.478295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56ce7b5f6c44abb9b3fcefeb3eb53a7', 'request_id': 'req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:20.491081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] The token cache is being invalidate because project e56ce7b5f6c44abb9b3fcefeb3eb53a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:20.491265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:20.492096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e99e55e5-50b0-4c1a-9c54-6350ba423ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:20.494333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 998/2017] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:20 2022] DELETE /identity/v3/projects/e56ce7b5f6c44abb9b3fcefeb3eb53a7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:20.502882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3642add-d480-4ea6-b082-8b5eaf845d09 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:20.503343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3642add-d480-4ea6-b082-8b5eaf845d09 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:20.503586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3642add-d480-4ea6-b082-8b5eaf845d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:20.523055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f3642add-d480-4ea6-b082-8b5eaf845d09 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:20.524306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f3642add-d480-4ea6-b082-8b5eaf845d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:20.605432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1020/2018] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:20.614622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a74ac-b532-4cd5-8013-1a0ab55fe244 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:20.615490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a74ac-b532-4cd5-8013-1a0ab55fe244 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:20.615777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a74ac-b532-4cd5-8013-1a0ab55fe244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:20.638994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-397a74ac-b532-4cd5-8013-1a0ab55fe244 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:20.640266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-397a74ac-b532-4cd5-8013-1a0ab55fe244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:20.650208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 999/2019] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:20.654796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3642add-d480-4ea6-b082-8b5eaf845d09 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:20.666539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3642add-d480-4ea6-b082-8b5eaf845d09 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:20.671118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc14303-2934-4cdf-9664-6bdb7b8700c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:20.671791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14303-2934-4cdf-9664-6bdb7b8700c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:20.672100 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14303-2934-4cdf-9664-6bdb7b8700c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:20.672372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14303-2934-4cdf-9664-6bdb7b8700c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:20.673117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc14303-2934-4cdf-9664-6bdb7b8700c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:20.673421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc14303-2934-4cdf-9664-6bdb7b8700c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:20.675084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc14303-2934-4cdf-9664-6bdb7b8700c9 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:20.699587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1021/2020] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:20.703699 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a74ac-b532-4cd5-8013-1a0ab55fe244 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:20.715163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a74ac-b532-4cd5-8013-1a0ab55fe244 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:20.722705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffef254-0689-4e12-801e-6d7aaf3ff39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:20.723806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef254-0689-4e12-801e-6d7aaf3ff39d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:20.724903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef254-0689-4e12-801e-6d7aaf3ff39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:20.725400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffef254-0689-4e12-801e-6d7aaf3ff39d admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:20.726581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffef254-0689-4e12-801e-6d7aaf3ff39d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:20.729049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffef254-0689-4e12-801e-6d7aaf3ff39d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:20.773778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1000/2021] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:20 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:14:20.778355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc14303-2934-4cdf-9664-6bdb7b8700c9 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:20.789476 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc14303-2934-4cdf-9664-6bdb7b8700c9 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:20.853102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb5a7f-9cc8-44b8-aa62-0108adc02aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:20.853765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb5a7f-9cc8-44b8-aa62-0108adc02aec admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:20.854115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb5a7f-9cc8-44b8-aa62-0108adc02aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:20.854501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb5a7f-9cc8-44b8-aa62-0108adc02aec admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:20.855961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb5a7f-9cc8-44b8-aa62-0108adc02aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:20.857296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb5a7f-9cc8-44b8-aa62-0108adc02aec admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:20.889126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1022/2022] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:20 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:20.889236 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffef254-0689-4e12-801e-6d7aaf3ff39d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:20.905081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffef254-0689-4e12-801e-6d7aaf3ff39d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:20.910258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccd93e-f775-46a6-b14f-50570f99c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:20.910939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccd93e-f775-46a6-b14f-50570f99c08b admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:20.911228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccd93e-f775-46a6-b14f-50570f99c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:20.911514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccd93e-f775-46a6-b14f-50570f99c08b admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:20.913220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccd93e-f775-46a6-b14f-50570f99c08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:20.914941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccd93e-f775-46a6-b14f-50570f99c08b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:20.931447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1001/2023] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:20.932577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb5a7f-9cc8-44b8-aa62-0108adc02aec admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:20.944136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb5a7f-9cc8-44b8-aa62-0108adc02aec admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:20.949083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f93833-d239-4da3-a0d9-c89b929c12b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:20.949813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f93833-d239-4da3-a0d9-c89b929c12b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:20.950224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f93833-d239-4da3-a0d9-c89b929c12b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:20.950587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f93833-d239-4da3-a0d9-c89b929c12b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:20.951404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f93833-d239-4da3-a0d9-c89b929c12b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:20.953718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f93833-d239-4da3-a0d9-c89b929c12b4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:20.967378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1023/2024] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:14:20.971553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccd93e-f775-46a6-b14f-50570f99c08b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:20.983610 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccd93e-f775-46a6-b14f-50570f99c08b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:20.988299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697e091-560e-473f-a10c-ac49841c1333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:20.989324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697e091-560e-473f-a10c-ac49841c1333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:20.989615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697e091-560e-473f-a10c-ac49841c1333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:20.990491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697e091-560e-473f-a10c-ac49841c1333 admin admin] PATH_INFO: `/v3/projects/702f2f3c729b4a45a09d19db307c633c/users/85b3bed03dec4e82a455e78d0bc9ece8/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:21.007627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697e091-560e-473f-a10c-ac49841c1333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=702f2f3c729b4a45a09d19db307c633c, user_id=85b3bed03dec4e82a455e78d0bc9ece8, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:21.010325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697e091-560e-473f-a10c-ac49841c1333 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:21.024033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1002/2025] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:20 2022] PUT /identity/v3/projects/702f2f3c729b4a45a09d19db307c633c/users/85b3bed03dec4e82a455e78d0bc9ece8/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:21.034889 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf635-e783-48a1-a0ce-64883075a7d6 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:21.035188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf635-e783-48a1-a0ce-64883075a7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:21.035500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf635-e783-48a1-a0ce-64883075a7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:21.064140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-93daf635-e783-48a1-a0ce-64883075a7d6 None None] MFA Rules not processed for user `85b3bed03dec4e82a455e78d0bc9ece8`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:21.065372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-93daf635-e783-48a1-a0ce-64883075a7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:21.114451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:21.136631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1024/2026] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:14:21.141130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697e091-560e-473f-a10c-ac49841c1333 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:21.223100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697e091-560e-473f-a10c-ac49841c1333 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:21.229270 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d9eec-6b22-43a1-9c6c-16f8841f4fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:21.229784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d9eec-6b22-43a1-9c6c-16f8841f4fdc admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:21.230189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d9eec-6b22-43a1-9c6c-16f8841f4fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:21.230559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d9eec-6b22-43a1-9c6c-16f8841f4fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:21.231338 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d9eec-6b22-43a1-9c6c-16f8841f4fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:21.233503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d9eec-6b22-43a1-9c6c-16f8841f4fdc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:21.237276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:21.279026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1003/2027] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:21 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:21.283027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf635-e783-48a1-a0ce-64883075a7d6 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:21.302338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf635-e783-48a1-a0ce-64883075a7d6 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:21.374540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e27f89-8483-4233-813f-21e694ad096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:21.375294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27f89-8483-4233-813f-21e694ad096d admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:21.375589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27f89-8483-4233-813f-21e694ad096d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:21.376063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27f89-8483-4233-813f-21e694ad096d admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:21.377006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e27f89-8483-4233-813f-21e694ad096d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:21.379480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e27f89-8483-4233-813f-21e694ad096d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:21.403941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1025/2028] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:21 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:21.407986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d9eec-6b22-43a1-9c6c-16f8841f4fdc admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:21.429148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d9eec-6b22-43a1-9c6c-16f8841f4fdc admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:21.434444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaba36-8135-4158-ab06-859845bfb4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:21.435311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaba36-8135-4158-ab06-859845bfb4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:21.435599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaba36-8135-4158-ab06-859845bfb4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:21.435948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaba36-8135-4158-ab06-859845bfb4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:21.436870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaba36-8135-4158-ab06-859845bfb4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:21.438697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eaba36-8135-4158-ab06-859845bfb4d9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:21.454541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1004/2029] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:21.455524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e27f89-8483-4233-813f-21e694ad096d admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:21.489525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e27f89-8483-4233-813f-21e694ad096d admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:21.500055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f8ce4d-84d5-4826-93bc-2ca088a985eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:21.500799 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ce4d-84d5-4826-93bc-2ca088a985eb admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:21.501052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ce4d-84d5-4826-93bc-2ca088a985eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:21.501335 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f8ce4d-84d5-4826-93bc-2ca088a985eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:21.503120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8ce4d-84d5-4826-93bc-2ca088a985eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:21.513199 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f8ce4d-84d5-4826-93bc-2ca088a985eb admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:21.526109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1026/2030] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:14:21.532726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaba36-8135-4158-ab06-859845bfb4d9 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:21.556707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaba36-8135-4158-ab06-859845bfb4d9 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:21.567965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95913e8-fe77-4adf-89b0-c3f70a7c2a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:21.571440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95913e8-fe77-4adf-89b0-c3f70a7c2a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:21.572009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95913e8-fe77-4adf-89b0-c3f70a7c2a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:21.572367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95913e8-fe77-4adf-89b0-c3f70a7c2a75 admin admin] PATH_INFO: `/v3/projects/5091e35d38e84406897af360a52cb43c/users/54e9124013ff4cdcb871c56482cb2b02/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:21.598100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95913e8-fe77-4adf-89b0-c3f70a7c2a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5091e35d38e84406897af360a52cb43c, user_id=54e9124013ff4cdcb871c56482cb2b02, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:21.601917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95913e8-fe77-4adf-89b0-c3f70a7c2a75 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:21.622067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1005/2031] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:21 2022] PUT /identity/v3/projects/5091e35d38e84406897af360a52cb43c/users/54e9124013ff4cdcb871c56482cb2b02/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:21.634509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1beffe-1f10-4dd8-a305-b01579ab8c96 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:21.634987 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1beffe-1f10-4dd8-a305-b01579ab8c96 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:21.635274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1beffe-1f10-4dd8-a305-b01579ab8c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:21.671285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-9d1beffe-1f10-4dd8-a305-b01579ab8c96 None None] MFA Rules not processed for user `54e9124013ff4cdcb871c56482cb2b02`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:21.671856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9d1beffe-1f10-4dd8-a305-b01579ab8c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:21.777417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1027/2032] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:21.778606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95913e8-fe77-4adf-89b0-c3f70a7c2a75 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:21.808912 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1beffe-1f10-4dd8-a305-b01579ab8c96 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:21.810904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9d1beffe-1f10-4dd8-a305-b01579ab8c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:21.877938 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95913e8-fe77-4adf-89b0-c3f70a7c2a75 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:21.888136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec30a4-4a40-4604-9b55-086ccecab64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:21.889419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec30a4-4a40-4604-9b55-086ccecab64b admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:21.889893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec30a4-4a40-4604-9b55-086ccecab64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:21.890588 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec30a4-4a40-4604-9b55-086ccecab64b admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:21.892043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec30a4-4a40-4604-9b55-086ccecab64b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:21.894753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec30a4-4a40-4604-9b55-086ccecab64b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:21.911414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:21.917863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1beffe-1f10-4dd8-a305-b01579ab8c96 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:21.930047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafc634-37ed-4977-9c87-6852e304feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:21.933179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1006/2033] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:21 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:21.934444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec30a4-4a40-4604-9b55-086ccecab64b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:21.935186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc634-37ed-4977-9c87-6852e304feaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:21.935562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc634-37ed-4977-9c87-6852e304feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:21.936142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafc634-37ed-4977-9c87-6852e304feaa admin admin] PATH_INFO: `/v3/users/3255474a29d34dd1985ebdb80f92bfb2` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:21.937407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafc634-37ed-4977-9c87-6852e304feaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3255474a29d34dd1985ebdb80f92bfb2)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:21.939685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafc634-37ed-4977-9c87-6852e304feaa admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:22.011289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-6cafc634-37ed-4977-9c87-6852e304feaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3255474a29d34dd1985ebdb80f92bfb2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:22.011947 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-6cafc634-37ed-4977-9c87-6852e304feaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3255474a29d34dd1985ebdb80f92bfb2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:22.012569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-6cafc634-37ed-4977-9c87-6852e304feaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3255474a29d34dd1985ebdb80f92bfb2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:22.019625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec30a4-4a40-4604-9b55-086ccecab64b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:22.025031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd32470-8819-49c1-9e10-442743c6891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:22.025341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-6cafc634-37ed-4977-9c87-6852e304feaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3255474a29d34dd1985ebdb80f92bfb2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:22.025722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32470-8819-49c1-9e10-442743c6891e admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:22.026007 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32470-8819-49c1-9e10-442743c6891e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:22.026319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd32470-8819-49c1-9e10-442743c6891e admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:22.027025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd32470-8819-49c1-9e10-442743c6891e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:22.028967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd32470-8819-49c1-9e10-442743c6891e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:22.038239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-6cafc634-37ed-4977-9c87-6852e304feaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3255474a29d34dd1985ebdb80f92bfb2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:22.057834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1007/2034] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:21 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:14:22.061418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1028/2035] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:21 2022] DELETE /identity/v3/users/3255474a29d34dd1985ebdb80f92bfb2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:22.062937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd32470-8819-49c1-9e10-442743c6891e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:22.065575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099adaff-ae65-4d08-9d4a-d39b11ceec79 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:22.065873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099adaff-ae65-4d08-9d4a-d39b11ceec79 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:22.066179 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099adaff-ae65-4d08-9d4a-d39b11ceec79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:22.067049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1dd32470-8819-49c1-9e10-442743c6891e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:22.079543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd32470-8819-49c1-9e10-442743c6891e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:22.092176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-099adaff-ae65-4d08-9d4a-d39b11ceec79 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:22.093408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-099adaff-ae65-4d08-9d4a-d39b11ceec79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:22.104794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:22.147269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab5c1b-f4f0-4da2-a32c-ed9a26e31f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:22.148076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5c1b-f4f0-4da2-a32c-ed9a26e31f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:22.148464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5c1b-f4f0-4da2-a32c-ed9a26e31f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:22.148808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab5c1b-f4f0-4da2-a32c-ed9a26e31f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:22.149548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab5c1b-f4f0-4da2-a32c-ed9a26e31f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:22.151253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab5c1b-f4f0-4da2-a32c-ed9a26e31f09 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:22.162741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1008/2036] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:22.166764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab5c1b-f4f0-4da2-a32c-ed9a26e31f09 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:22.170357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1029/2037] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:22.178896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab5c1b-f4f0-4da2-a32c-ed9a26e31f09 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:22.180839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099adaff-ae65-4d08-9d4a-d39b11ceec79 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:22.183240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-099adaff-ae65-4d08-9d4a-d39b11ceec79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:22.184160 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a36284-cf07-4dad-883d-4647b6e2ea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:22.185057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36284-cf07-4dad-883d-4647b6e2ea63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:22.185352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36284-cf07-4dad-883d-4647b6e2ea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:22.185635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36284-cf07-4dad-883d-4647b6e2ea63 admin admin] PATH_INFO: `/v3/projects/bfdcc9d01e7b473aa70549d501a91c10/users/a204e27815644c91ab4a61031f1ef0a4/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:22.202575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a36284-cf07-4dad-883d-4647b6e2ea63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdcc9d01e7b473aa70549d501a91c10, user_id=a204e27815644c91ab4a61031f1ef0a4, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:22.205531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a36284-cf07-4dad-883d-4647b6e2ea63 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:22.224525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1009/2038] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:22 2022] PUT /identity/v3/projects/bfdcc9d01e7b473aa70549d501a91c10/users/a204e27815644c91ab4a61031f1ef0a4/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:22.229625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a36284-cf07-4dad-883d-4647b6e2ea63 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:22.264851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099adaff-ae65-4d08-9d4a-d39b11ceec79 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:22.298866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:22.309203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a36284-cf07-4dad-883d-4647b6e2ea63 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:22.315679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1728ce4-7fa2-4a3e-b4df-898e98ba976c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:22.316396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1728ce4-7fa2-4a3e-b4df-898e98ba976c admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:22.316665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1728ce4-7fa2-4a3e-b4df-898e98ba976c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:22.317435 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1728ce4-7fa2-4a3e-b4df-898e98ba976c admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:22.317699 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1728ce4-7fa2-4a3e-b4df-898e98ba976c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:22.319680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1728ce4-7fa2-4a3e-b4df-898e98ba976c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:22.327835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56e9c6-8b2a-4680-81fb-4f21b5c050a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:22.328792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56e9c6-8b2a-4680-81fb-4f21b5c050a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:22.329322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56e9c6-8b2a-4680-81fb-4f21b5c050a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:22.329812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56e9c6-8b2a-4680-81fb-4f21b5c050a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:22.334189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1010/2039] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:14:22.335403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1728ce4-7fa2-4a3e-b4df-898e98ba976c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:22.348277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1728ce4-7fa2-4a3e-b4df-898e98ba976c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:22.350955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56e9c6-8b2a-4680-81fb-4f21b5c050a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:22.352557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56e9c6-8b2a-4680-81fb-4f21b5c050a6 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:22.354380 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e11fb-5f94-41d9-ad59-620284ef2baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:22.355451 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e11fb-5f94-41d9-ad59-620284ef2baf admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:22.355883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e11fb-5f94-41d9-ad59-620284ef2baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:22.356324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e11fb-5f94-41d9-ad59-620284ef2baf admin admin] PATH_INFO: `/v3/projects/bfdcc9d01e7b473aa70549d501a91c10/users/a204e27815644c91ab4a61031f1ef0a4/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:22.359094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e11fb-5f94-41d9-ad59-620284ef2baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdcc9d01e7b473aa70549d501a91c10, user_id=a204e27815644c91ab4a61031f1ef0a4, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:22.361921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e11fb-5f94-41d9-ad59-620284ef2baf admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:22.363393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1030/2040] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:14:22.374954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1011/2041] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:22 2022] PUT /identity/v3/projects/bfdcc9d01e7b473aa70549d501a91c10/users/a204e27815644c91ab4a61031f1ef0a4/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:22.390796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a54977-c608-4cb7-b87d-fb4f6dcc0596 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:22.391091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a54977-c608-4cb7-b87d-fb4f6dcc0596 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:22.391369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a54977-c608-4cb7-b87d-fb4f6dcc0596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:22.431592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b1a54977-c608-4cb7-b87d-fb4f6dcc0596 None None] MFA Rules not processed for user `a204e27815644c91ab4a61031f1ef0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:22.432815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b1a54977-c608-4cb7-b87d-fb4f6dcc0596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:22.517985 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1031/2042] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:22.529879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e11fb-5f94-41d9-ad59-620284ef2baf admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:22.531710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2d5e11fb-5f94-41d9-ad59-620284ef2baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:22.596400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e11fb-5f94-41d9-ad59-620284ef2baf admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:22.600797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590980c9-0070-47f0-9f07-9861c44cf63f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:22.601488 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590980c9-0070-47f0-9f07-9861c44cf63f service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:22.601846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590980c9-0070-47f0-9f07-9861c44cf63f service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:22.602131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590980c9-0070-47f0-9f07-9861c44cf63f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:22.604072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-590980c9-0070-47f0-9f07-9861c44cf63f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:22.641122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:22.670841 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590980c9-0070-47f0-9f07-9861c44cf63f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:22.672516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590980c9-0070-47f0-9f07-9861c44cf63f service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:22.683219 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1012/2043] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:23.019977 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a54977-c608-4cb7-b87d-fb4f6dcc0596 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:23.023001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b1a54977-c608-4cb7-b87d-fb4f6dcc0596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:23.148106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a54977-c608-4cb7-b87d-fb4f6dcc0596 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:23.155544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:23.156465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:23.156922 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:23.157214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] PATH_INFO: `/v3/projects/662a481e55f447928c7d6fd589f3a5ae` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:23.158851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662a481e55f447928c7d6fd589f3a5ae)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:23.160953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:23.226096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662a481e55f447928c7d6fd589f3a5ae', 'request_id': 'req-e81c1b35-6aea-4289-b782-14599332acc4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.233435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662a481e55f447928c7d6fd589f3a5ae', 'request_id': 'req-e81c1b35-6aea-4289-b782-14599332acc4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.239797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662a481e55f447928c7d6fd589f3a5ae', 'request_id': 'req-e81c1b35-6aea-4289-b782-14599332acc4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.241651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:23.253695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] The token cache is being invalidate because project 662a481e55f447928c7d6fd589f3a5ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:23.253990 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.254755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.257803 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1032/2044] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:23 2022] DELETE /identity/v3/projects/662a481e55f447928c7d6fd589f3a5ae => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:23.264205 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590980c9-0070-47f0-9f07-9861c44cf63f service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:23.276251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590980c9-0070-47f0-9f07-9861c44cf63f service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:23.340914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857d2a6-4015-444c-bb5b-5a7d015e1568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:23.341797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d2a6-4015-444c-bb5b-5a7d015e1568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:23.342084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d2a6-4015-444c-bb5b-5a7d015e1568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:23.342384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d2a6-4015-444c-bb5b-5a7d015e1568 admin admin] PATH_INFO: `/v3/users/2c3ed8adc1a6463d88f8aaf87201e3fa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:23.343746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857d2a6-4015-444c-bb5b-5a7d015e1568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c3ed8adc1a6463d88f8aaf87201e3fa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:23.345780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857d2a6-4015-444c-bb5b-5a7d015e1568 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:23.398279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6857d2a6-4015-444c-bb5b-5a7d015e1568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c3ed8adc1a6463d88f8aaf87201e3fa'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.398953 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6857d2a6-4015-444c-bb5b-5a7d015e1568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c3ed8adc1a6463d88f8aaf87201e3fa'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.399622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6857d2a6-4015-444c-bb5b-5a7d015e1568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c3ed8adc1a6463d88f8aaf87201e3fa'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.407288 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6857d2a6-4015-444c-bb5b-5a7d015e1568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c3ed8adc1a6463d88f8aaf87201e3fa'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.420402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6857d2a6-4015-444c-bb5b-5a7d015e1568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c3ed8adc1a6463d88f8aaf87201e3fa'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.440839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1013/2045] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:23 2022] DELETE /identity/v3/users/2c3ed8adc1a6463d88f8aaf87201e3fa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:23.729797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:23.731270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:23.746449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c1b35-6aea-4289-b782-14599332acc4 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:23.809110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:23.809737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:23.810095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:23.810483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] PATH_INFO: `/v3/projects/6893e9b4bc2b4d5ebf3f08d04bffd6bb` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:23.811771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6893e9b4bc2b4d5ebf3f08d04bffd6bb)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:23.813786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:23.868140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6893e9b4bc2b4d5ebf3f08d04bffd6bb', 'request_id': 'req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.875176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6893e9b4bc2b4d5ebf3f08d04bffd6bb', 'request_id': 'req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.881950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6893e9b4bc2b4d5ebf3f08d04bffd6bb', 'request_id': 'req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.896178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] The token cache is being invalidate because project 6893e9b4bc2b4d5ebf3f08d04bffd6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:23.896572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.897757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d5cb98d4-3ef1-4ba6-81f6-0374121b1275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:23.899590 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1033/2046] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:23 2022] DELETE /identity/v3/projects/6893e9b4bc2b4d5ebf3f08d04bffd6bb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:23.904470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3682f8-0ac1-45e2-ace6-dd9e2c3688ad None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:23.905078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3682f8-0ac1-45e2-ace6-dd9e2c3688ad None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:23.905078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3682f8-0ac1-45e2-ace6-dd9e2c3688ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:23.923517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5d3682f8-0ac1-45e2-ace6-dd9e2c3688ad None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:23.924760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5d3682f8-0ac1-45e2-ace6-dd9e2c3688ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:23.980022 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:24.002508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1014/2047] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:24.004159 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c238-9990-4011-901b-0d68954862ee None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.004451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c238-9990-4011-901b-0d68954862ee None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.004733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c238-9990-4011-901b-0d68954862ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.025964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-dc57c238-9990-4011-901b-0d68954862ee None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:24.027419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-dc57c238-9990-4011-901b-0d68954862ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:24.037359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1034/2048] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:24.041650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3682f8-0ac1-45e2-ace6-dd9e2c3688ad None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:24.051495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3682f8-0ac1-45e2-ace6-dd9e2c3688ad None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:24.056774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c0df1-2e83-4ed4-95d9-3c0e1d6f8ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:24.057441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c0df1-2e83-4ed4-95d9-3c0e1d6f8ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.057722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c0df1-2e83-4ed4-95d9-3c0e1d6f8ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.057992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c0df1-2e83-4ed4-95d9-3c0e1d6f8ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.058758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c0df1-2e83-4ed4-95d9-3c0e1d6f8ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:24.059064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c0df1-2e83-4ed4-95d9-3c0e1d6f8ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:24.060736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c0df1-2e83-4ed4-95d9-3c0e1d6f8ed1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:24.073678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1015/2049] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:24.078396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57c238-9990-4011-901b-0d68954862ee None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:24.088138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57c238-9990-4011-901b-0d68954862ee None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:24.092799 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef1c55-53dc-4ad3-952b-83bf7bbdef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:24.093494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef1c55-53dc-4ad3-952b-83bf7bbdef21 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.093781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef1c55-53dc-4ad3-952b-83bf7bbdef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.094076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef1c55-53dc-4ad3-952b-83bf7bbdef21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.094812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef1c55-53dc-4ad3-952b-83bf7bbdef21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:24.096729 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef1c55-53dc-4ad3-952b-83bf7bbdef21 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:24.126424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1035/2050] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:24 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:24.131073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c0df1-2e83-4ed4-95d9-3c0e1d6f8ed1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:24.149601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c0df1-2e83-4ed4-95d9-3c0e1d6f8ed1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:24.226413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8278f-432b-450f-8762-4ea256f5df50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:24.227336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8278f-432b-450f-8762-4ea256f5df50 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.227624 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8278f-432b-450f-8762-4ea256f5df50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.227904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8278f-432b-450f-8762-4ea256f5df50 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.228631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8278f-432b-450f-8762-4ea256f5df50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:24.230693 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8278f-432b-450f-8762-4ea256f5df50 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:24.258464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1016/2051] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:24 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:24.259862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef1c55-53dc-4ad3-952b-83bf7bbdef21 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:24.271100 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef1c55-53dc-4ad3-952b-83bf7bbdef21 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:24.276233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a874f2-3763-4fa8-aa03-6b406f29f296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:24.276918 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a874f2-3763-4fa8-aa03-6b406f29f296 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.277212 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a874f2-3763-4fa8-aa03-6b406f29f296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.277495 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a874f2-3763-4fa8-aa03-6b406f29f296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.278291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a874f2-3763-4fa8-aa03-6b406f29f296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:24.280581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a874f2-3763-4fa8-aa03-6b406f29f296 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:24.292757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1036/2052] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:24.297651 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8278f-432b-450f-8762-4ea256f5df50 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:24.308204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8278f-432b-450f-8762-4ea256f5df50 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:24.313257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05363811-2d79-4bf9-8947-a36e03fe49ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:24.314004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05363811-2d79-4bf9-8947-a36e03fe49ff admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.314328 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05363811-2d79-4bf9-8947-a36e03fe49ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.314609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05363811-2d79-4bf9-8947-a36e03fe49ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.315333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05363811-2d79-4bf9-8947-a36e03fe49ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:24.317073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05363811-2d79-4bf9-8947-a36e03fe49ff admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:24.337166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1017/2053] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:14:24.338418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a874f2-3763-4fa8-aa03-6b406f29f296 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:24.350218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a874f2-3763-4fa8-aa03-6b406f29f296 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:24.356537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eb444-167e-43c8-9d0a-f1397c0c8e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:24.357447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb444-167e-43c8-9d0a-f1397c0c8e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.357741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb444-167e-43c8-9d0a-f1397c0c8e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.358025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb444-167e-43c8-9d0a-f1397c0c8e66 admin admin] PATH_INFO: `/v3/projects/31dd64d55d8d40f6827551b688923180/users/a056332fdd0441889a4893243ea98039/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.377847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4eb444-167e-43c8-9d0a-f1397c0c8e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31dd64d55d8d40f6827551b688923180, user_id=a056332fdd0441889a4893243ea98039, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:24.380550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4eb444-167e-43c8-9d0a-f1397c0c8e66 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:24.399351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1037/2054] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:24 2022] PUT /identity/v3/projects/31dd64d55d8d40f6827551b688923180/users/a056332fdd0441889a4893243ea98039/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:24.409692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b232e9b-33ea-426e-b2fd-c495db9b089b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.410019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b232e9b-33ea-426e-b2fd-c495db9b089b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.410331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b232e9b-33ea-426e-b2fd-c495db9b089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.438291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9b232e9b-33ea-426e-b2fd-c495db9b089b None None] MFA Rules not processed for user `a056332fdd0441889a4893243ea98039`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:24.439520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9b232e9b-33ea-426e-b2fd-c495db9b089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:24.516375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1018/2055] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:24.521818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eb444-167e-43c8-9d0a-f1397c0c8e66 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:24.547344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:24.625077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eb444-167e-43c8-9d0a-f1397c0c8e66 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:24.629964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4802a-e365-47b5-9041-e37ecec44f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:24.631525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4802a-e365-47b5-9041-e37ecec44f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.631811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4802a-e365-47b5-9041-e37ecec44f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.632091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4802a-e365-47b5-9041-e37ecec44f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.632826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4802a-e365-47b5-9041-e37ecec44f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:24.634936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4802a-e365-47b5-9041-e37ecec44f2f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:24.665617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1038/2056] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:24 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:24.666819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b232e9b-33ea-426e-b2fd-c495db9b089b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:24.678402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b232e9b-33ea-426e-b2fd-c495db9b089b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:24.726430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:24.740857 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dd718-1b41-473c-95cb-5cbd55a43407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:24.741555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd718-1b41-473c-95cb-5cbd55a43407 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.741844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd718-1b41-473c-95cb-5cbd55a43407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.742127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dd718-1b41-473c-95cb-5cbd55a43407 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.742869 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dd718-1b41-473c-95cb-5cbd55a43407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:24.744811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dd718-1b41-473c-95cb-5cbd55a43407 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:24.766417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1019/2057] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:24 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:24.770494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4802a-e365-47b5-9041-e37ecec44f2f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:24.781222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4802a-e365-47b5-9041-e37ecec44f2f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:24.786466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68a2e5-3926-4beb-a718-580c4809a6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:24.787237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68a2e5-3926-4beb-a718-580c4809a6ec admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.787775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68a2e5-3926-4beb-a718-580c4809a6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.788163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68a2e5-3926-4beb-a718-580c4809a6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.788960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68a2e5-3926-4beb-a718-580c4809a6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:24.790719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68a2e5-3926-4beb-a718-580c4809a6ec admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:24.802869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1039/2058] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:24.806879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dd718-1b41-473c-95cb-5cbd55a43407 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:24.817274 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dd718-1b41-473c-95cb-5cbd55a43407 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:24.822524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cf176-00ac-480c-9d24-87c4043521ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:24.823207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cf176-00ac-480c-9d24-87c4043521ad admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.823496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cf176-00ac-480c-9d24-87c4043521ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.823776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cf176-00ac-480c-9d24-87c4043521ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.824515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cf176-00ac-480c-9d24-87c4043521ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:24.826128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cf176-00ac-480c-9d24-87c4043521ad admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:24.837101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1020/2059] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:24.841550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68a2e5-3926-4beb-a718-580c4809a6ec admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:24.852150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68a2e5-3926-4beb-a718-580c4809a6ec admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:24.856956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3f162-6727-4df1-acdb-3654731fe726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:24.857855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3f162-6727-4df1-acdb-3654731fe726 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.858197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3f162-6727-4df1-acdb-3654731fe726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.858473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3f162-6727-4df1-acdb-3654731fe726 admin admin] PATH_INFO: `/v3/projects/04bcb522d444425fa2417b2f0176801e/users/5b232ada729c4e44abcacc9372c5959d/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.878260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3f162-6727-4df1-acdb-3654731fe726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04bcb522d444425fa2417b2f0176801e, user_id=5b232ada729c4e44abcacc9372c5959d, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:24.881470 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3f162-6727-4df1-acdb-3654731fe726 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:24.899913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1040/2060] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:24 2022] PUT /identity/v3/projects/04bcb522d444425fa2417b2f0176801e/users/5b232ada729c4e44abcacc9372c5959d/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:24.914292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a6bf7-46bf-4c93-803d-dbf995e0aed9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:24.914739 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a6bf7-46bf-4c93-803d-dbf995e0aed9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:24.914739 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a6bf7-46bf-4c93-803d-dbf995e0aed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:24.944114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-637a6bf7-46bf-4c93-803d-dbf995e0aed9 None None] MFA Rules not processed for user `5b232ada729c4e44abcacc9372c5959d`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:24.945244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-637a6bf7-46bf-4c93-803d-dbf995e0aed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:25.020072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1021/2061] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:25.024956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3f162-6727-4df1-acdb-3654731fe726 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:25.093701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3f162-6727-4df1-acdb-3654731fe726 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:25.098665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74fc84-cf02-4dcb-8631-56790dcbd360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:25.099380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74fc84-cf02-4dcb-8631-56790dcbd360 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:25.099665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74fc84-cf02-4dcb-8631-56790dcbd360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:25.099967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74fc84-cf02-4dcb-8631-56790dcbd360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:25.100713 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74fc84-cf02-4dcb-8631-56790dcbd360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:25.102683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74fc84-cf02-4dcb-8631-56790dcbd360 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:25.134696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1041/2062] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:25 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:25.136312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a6bf7-46bf-4c93-803d-dbf995e0aed9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:25.159467 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a6bf7-46bf-4c93-803d-dbf995e0aed9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:25.316441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d873c-e423-4283-8671-2d0e17f6fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:25.317826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d873c-e423-4283-8671-2d0e17f6fc54 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:25.319447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d873c-e423-4283-8671-2d0e17f6fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:25.319935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d873c-e423-4283-8671-2d0e17f6fc54 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:25.321189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d873c-e423-4283-8671-2d0e17f6fc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:25.326981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d873c-e423-4283-8671-2d0e17f6fc54 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:25.387611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74fc84-cf02-4dcb-8631-56790dcbd360 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:25.394871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1022/2063] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:25 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:25.403378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74fc84-cf02-4dcb-8631-56790dcbd360 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:25.410140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426975fc-358e-4680-8c04-43f55eec2c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:25.410952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426975fc-358e-4680-8c04-43f55eec2c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:25.411504 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426975fc-358e-4680-8c04-43f55eec2c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:25.412059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426975fc-358e-4680-8c04-43f55eec2c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:25.413155 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426975fc-358e-4680-8c04-43f55eec2c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:25.414824 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426975fc-358e-4680-8c04-43f55eec2c4a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:25.431292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1042/2064] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:25.435516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d873c-e423-4283-8671-2d0e17f6fc54 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:25.447620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d873c-e423-4283-8671-2d0e17f6fc54 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:25.454544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c539bc-1b48-42d9-8690-5bac1e960145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:25.454544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c539bc-1b48-42d9-8690-5bac1e960145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:25.454544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c539bc-1b48-42d9-8690-5bac1e960145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:25.454544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c539bc-1b48-42d9-8690-5bac1e960145 admin admin] PATH_INFO: `/v3/projects/0f86c87bcf4d4beb83174e408ed14e76/users/2b1d414c2c6a430484f8b3857a6c3a1f/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:25.477687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c539bc-1b48-42d9-8690-5bac1e960145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f86c87bcf4d4beb83174e408ed14e76, user_id=2b1d414c2c6a430484f8b3857a6c3a1f, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:25.481611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c539bc-1b48-42d9-8690-5bac1e960145 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:25.500531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1023/2065] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:25 2022] PUT /identity/v3/projects/0f86c87bcf4d4beb83174e408ed14e76/users/2b1d414c2c6a430484f8b3857a6c3a1f/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:25.504712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426975fc-358e-4680-8c04-43f55eec2c4a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:25.517173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426975fc-358e-4680-8c04-43f55eec2c4a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:25.568666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:25.592642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e52272-f8ef-47e1-b50b-a550092f2b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:25.593443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e52272-f8ef-47e1-b50b-a550092f2b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:25.593812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e52272-f8ef-47e1-b50b-a550092f2b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:25.594197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e52272-f8ef-47e1-b50b-a550092f2b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:25.595047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e52272-f8ef-47e1-b50b-a550092f2b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:25.596731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e52272-f8ef-47e1-b50b-a550092f2b44 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:25.608236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1043/2066] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:25.612099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c539bc-1b48-42d9-8690-5bac1e960145 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:25.624135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c539bc-1b48-42d9-8690-5bac1e960145 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:25.630201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141dc8d-5fb1-4041-bcdc-674f93087f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:25.631937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141dc8d-5fb1-4041-bcdc-674f93087f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:25.632279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141dc8d-5fb1-4041-bcdc-674f93087f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:25.632647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141dc8d-5fb1-4041-bcdc-674f93087f62 admin admin] PATH_INFO: `/v3/projects/0f86c87bcf4d4beb83174e408ed14e76/users/2b1d414c2c6a430484f8b3857a6c3a1f/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:25.634904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141dc8d-5fb1-4041-bcdc-674f93087f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f86c87bcf4d4beb83174e408ed14e76, user_id=2b1d414c2c6a430484f8b3857a6c3a1f, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:25.638140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141dc8d-5fb1-4041-bcdc-674f93087f62 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:25.661999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1024/2067] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:25 2022] PUT /identity/v3/projects/0f86c87bcf4d4beb83174e408ed14e76/users/2b1d414c2c6a430484f8b3857a6c3a1f/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:25.663997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d6952-eade-4e50-a19e-7a83dadb37cc None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:25.664513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d6952-eade-4e50-a19e-7a83dadb37cc None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:25.665015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d6952-eade-4e50-a19e-7a83dadb37cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:25.728332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b95d6952-eade-4e50-a19e-7a83dadb37cc None None] MFA Rules not processed for user `2b1d414c2c6a430484f8b3857a6c3a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:25.729827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b95d6952-eade-4e50-a19e-7a83dadb37cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:25.899724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1044/2068] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:25.910023 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141dc8d-5fb1-4041-bcdc-674f93087f62 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:25.912980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5141dc8d-5fb1-4041-bcdc-674f93087f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:25.926453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:25.984391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141dc8d-5fb1-4041-bcdc-674f93087f62 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:25.988068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef1c0d-82ac-4397-bddb-958e8db83259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:25.988732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1c0d-82ac-4397-bddb-958e8db83259 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:25.989021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1c0d-82ac-4397-bddb-958e8db83259 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:25.989302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef1c0d-82ac-4397-bddb-958e8db83259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:26.002450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef1c0d-82ac-4397-bddb-958e8db83259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:26.003923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef1c0d-82ac-4397-bddb-958e8db83259 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:26.014560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1025/2069] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:26.120292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d6952-eade-4e50-a19e-7a83dadb37cc None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:26.130656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d6952-eade-4e50-a19e-7a83dadb37cc None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:26.134616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a91db-23a5-484d-923e-955bc7eda5b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:26.135615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a91db-23a5-484d-923e-955bc7eda5b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:26.135615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a91db-23a5-484d-923e-955bc7eda5b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:26.135863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a91db-23a5-484d-923e-955bc7eda5b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:26.202131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a91db-23a5-484d-923e-955bc7eda5b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:26.204312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a91db-23a5-484d-923e-955bc7eda5b9 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:26.219951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1045/2070] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:27.152963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef1c0d-82ac-4397-bddb-958e8db83259 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:27.163313 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef1c0d-82ac-4397-bddb-958e8db83259 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:27.168021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168906f-b78c-4b3c-b5d8-49ded2cc9227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:27.168756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168906f-b78c-4b3c-b5d8-49ded2cc9227 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:27.169228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168906f-b78c-4b3c-b5d8-49ded2cc9227 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:27.169446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168906f-b78c-4b3c-b5d8-49ded2cc9227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:27.171621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5168906f-b78c-4b3c-b5d8-49ded2cc9227 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:27.253056 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168906f-b78c-4b3c-b5d8-49ded2cc9227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:27.254720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168906f-b78c-4b3c-b5d8-49ded2cc9227 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:27.264407 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1026/2071] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:27.967349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a91db-23a5-484d-923e-955bc7eda5b9 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:27.968867 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-774a91db-23a5-484d-923e-955bc7eda5b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:27.981990 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a91db-23a5-484d-923e-955bc7eda5b9 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:27.986884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60c8ad-9a9c-49fe-86f8-cd80f4d6ee36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:27.987628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60c8ad-9a9c-49fe-86f8-cd80f4d6ee36 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:27.988163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60c8ad-9a9c-49fe-86f8-cd80f4d6ee36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:27.988591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60c8ad-9a9c-49fe-86f8-cd80f4d6ee36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:27.990671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ec60c8ad-9a9c-49fe-86f8-cd80f4d6ee36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:28.064180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:28.066676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60c8ad-9a9c-49fe-86f8-cd80f4d6ee36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:28.068672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60c8ad-9a9c-49fe-86f8-cd80f4d6ee36 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:28.078753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1046/2072] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:29.898399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168906f-b78c-4b3c-b5d8-49ded2cc9227 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:29.984620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168906f-b78c-4b3c-b5d8-49ded2cc9227 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:29.991264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:29.992155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:29.992442 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:29.992721 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] PATH_INFO: `/v3/users/a056332fdd0441889a4893243ea98039` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:29.994358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a056332fdd0441889a4893243ea98039)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:29.997151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:30.066674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a056332fdd0441889a4893243ea98039'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.067978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a056332fdd0441889a4893243ea98039'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.068601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a056332fdd0441889a4893243ea98039'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.073988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:30.078366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a056332fdd0441889a4893243ea98039'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.094345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a056332fdd0441889a4893243ea98039'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.107929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1027/2073] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:29 2022] DELETE /identity/v3/users/a056332fdd0441889a4893243ea98039 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:30.112722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b02b2-b58e-4f13-8f65-2c3cd22a36b3 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:30.113220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b02b2-b58e-4f13-8f65-2c3cd22a36b3 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:30.113336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b02b2-b58e-4f13-8f65-2c3cd22a36b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:30.131293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4d2b02b2-b58e-4f13-8f65-2c3cd22a36b3 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:30.132741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4d2b02b2-b58e-4f13-8f65-2c3cd22a36b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:30.199775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1047/2074] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:30.210833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:30.214809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:30.276725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2af8bf-5bb8-4afa-bab6-d42a65f82853 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:30.280486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306a0d1-aede-4263-aeb3-9d206b0e9e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:30.281146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306a0d1-aede-4263-aeb3-9d206b0e9e28 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:30.281437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306a0d1-aede-4263-aeb3-9d206b0e9e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:30.281716 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306a0d1-aede-4263-aeb3-9d206b0e9e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:30.291850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306a0d1-aede-4263-aeb3-9d206b0e9e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:30.293306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7306a0d1-aede-4263-aeb3-9d206b0e9e28 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:30.305070 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1028/2075] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:30.593326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b02b2-b58e-4f13-8f65-2c3cd22a36b3 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:30.594875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4d2b02b2-b58e-4f13-8f65-2c3cd22a36b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:30.612464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b02b2-b58e-4f13-8f65-2c3cd22a36b3 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:30.618901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:30.619905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:30.620068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:30.620341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] PATH_INFO: `/v3/projects/31dd64d55d8d40f6827551b688923180` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:30.621645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=31dd64d55d8d40f6827551b688923180)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:30.623598 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:30.679585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31dd64d55d8d40f6827551b688923180', 'request_id': 'req-29ac0e50-5f73-4f69-8749-14fd090bbe5a'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.687967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31dd64d55d8d40f6827551b688923180', 'request_id': 'req-29ac0e50-5f73-4f69-8749-14fd090bbe5a'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.695356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31dd64d55d8d40f6827551b688923180', 'request_id': 'req-29ac0e50-5f73-4f69-8749-14fd090bbe5a'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.712060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] The token cache is being invalidate because project 31dd64d55d8d40f6827551b688923180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:30.712464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.715092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.717798 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1048/2076] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:30 2022] DELETE /identity/v3/projects/31dd64d55d8d40f6827551b688923180 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:30.722519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306a0d1-aede-4263-aeb3-9d206b0e9e28 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:30.733737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306a0d1-aede-4263-aeb3-9d206b0e9e28 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:30.807005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:30.810474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:30.824076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709979eb-1b48-452c-8278-8bb52d93f75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:30.825071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709979eb-1b48-452c-8278-8bb52d93f75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:30.825637 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709979eb-1b48-452c-8278-8bb52d93f75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:30.825927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709979eb-1b48-452c-8278-8bb52d93f75e admin admin] PATH_INFO: `/v3/users/5b232ada729c4e44abcacc9372c5959d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:30.827690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709979eb-1b48-452c-8278-8bb52d93f75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b232ada729c4e44abcacc9372c5959d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:30.830265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709979eb-1b48-452c-8278-8bb52d93f75e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:30.920424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac0e50-5f73-4f69-8749-14fd090bbe5a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:30.926839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:30.927660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-709979eb-1b48-452c-8278-8bb52d93f75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b232ada729c4e44abcacc9372c5959d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.928407 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-709979eb-1b48-452c-8278-8bb52d93f75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b232ada729c4e44abcacc9372c5959d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.928567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:30.928859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:30.929157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] PATH_INFO: `/v3/users/d04e85d2bf0a4299a76ed11e003b55fa` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:30.929446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-709979eb-1b48-452c-8278-8bb52d93f75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b232ada729c4e44abcacc9372c5959d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.934349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04e85d2bf0a4299a76ed11e003b55fa)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:30.934588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:30.944446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-709979eb-1b48-452c-8278-8bb52d93f75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b232ada729c4e44abcacc9372c5959d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.957553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-709979eb-1b48-452c-8278-8bb52d93f75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b232ada729c4e44abcacc9372c5959d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:30.959501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:30.965829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:30.979794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1029/2077] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:30 2022] DELETE /identity/v3/users/5b232ada729c4e44abcacc9372c5959d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:31.008602 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04e85d2bf0a4299a76ed11e003b55fa'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.009379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04e85d2bf0a4299a76ed11e003b55fa'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.010236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04e85d2bf0a4299a76ed11e003b55fa'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.021935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04e85d2bf0a4299a76ed11e003b55fa'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.037699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04e85d2bf0a4299a76ed11e003b55fa'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.075880 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1049/2078] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:30 2022] DELETE /identity/v3/users/d04e85d2bf0a4299a76ed11e003b55fa => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:31.081186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7ae2b-528a-4189-a1a2-52b861e66858 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:31.081530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7ae2b-528a-4189-a1a2-52b861e66858 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:31.081873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7ae2b-528a-4189-a1a2-52b861e66858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:31.110293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-78a7ae2b-528a-4189-a1a2-52b861e66858 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:31.111893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-78a7ae2b-528a-4189-a1a2-52b861e66858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:31.193428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1030/2079] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:31.206329 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:31.213692 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:31.281494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f0f5d-d527-4039-935c-64e4f4c5ca67 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:31.285302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997eb07-362f-4128-a214-3012f5d231c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:31.285963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997eb07-362f-4128-a214-3012f5d231c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:31.286330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997eb07-362f-4128-a214-3012f5d231c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:31.286669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997eb07-362f-4128-a214-3012f5d231c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:31.296418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997eb07-362f-4128-a214-3012f5d231c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:31.297879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997eb07-362f-4128-a214-3012f5d231c2 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:31.308540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1050/2080] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:31.378270 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7ae2b-528a-4189-a1a2-52b861e66858 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:31.381563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-78a7ae2b-528a-4189-a1a2-52b861e66858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:31.395170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7ae2b-528a-4189-a1a2-52b861e66858 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:31.410542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:31.411873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:31.413061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:31.413581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] PATH_INFO: `/v3/projects/04bcb522d444425fa2417b2f0176801e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:31.426086 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04bcb522d444425fa2417b2f0176801e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:31.428944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:31.491885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04bcb522d444425fa2417b2f0176801e', 'request_id': 'req-9ff73573-7842-4f13-a018-8544314a6b78'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.503281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04bcb522d444425fa2417b2f0176801e', 'request_id': 'req-9ff73573-7842-4f13-a018-8544314a6b78'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.515410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04bcb522d444425fa2417b2f0176801e', 'request_id': 'req-9ff73573-7842-4f13-a018-8544314a6b78'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.531139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] The token cache is being invalidate because project 04bcb522d444425fa2417b2f0176801e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:31.531797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.532645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.534329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1031/2081] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:31 2022] DELETE /identity/v3/projects/04bcb522d444425fa2417b2f0176801e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:31.539047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997eb07-362f-4128-a214-3012f5d231c2 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:31.550362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997eb07-362f-4128-a214-3012f5d231c2 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:31.638830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:31.639844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:31.640203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:31.641120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] PATH_INFO: `/v3/users/2b1d414c2c6a430484f8b3857a6c3a1f` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:31.642458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1d414c2c6a430484f8b3857a6c3a1f)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:31.644430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:31.704379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:31.706348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:31.713933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:31.720688 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1d414c2c6a430484f8b3857a6c3a1f'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.733687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1d414c2c6a430484f8b3857a6c3a1f'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.734735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff73573-7842-4f13-a018-8544314a6b78 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:31.735214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1d414c2c6a430484f8b3857a6c3a1f'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.740801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:31.742138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:31.742521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:31.743050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] PATH_INFO: `/v3/projects/5f3e6a25d7334bda93a801fd187c5253` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:31.744387 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f3e6a25d7334bda93a801fd187c5253)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:31.746779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:31.753767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1d414c2c6a430484f8b3857a6c3a1f'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.768958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1d414c2c6a430484f8b3857a6c3a1f'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.795460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1051/2082] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:31 2022] DELETE /identity/v3/users/2b1d414c2c6a430484f8b3857a6c3a1f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:31.820014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f3e6a25d7334bda93a801fd187c5253', 'request_id': 'req-86d4e055-2e8c-42db-9b46-1f465dcd10db'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.827635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f3e6a25d7334bda93a801fd187c5253', 'request_id': 'req-86d4e055-2e8c-42db-9b46-1f465dcd10db'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.840546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f3e6a25d7334bda93a801fd187c5253', 'request_id': 'req-86d4e055-2e8c-42db-9b46-1f465dcd10db'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.853048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=3,keystone:DELETE=15,keystone:SELECT=82 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:31.861348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] The token cache is being invalidate because project 5f3e6a25d7334bda93a801fd187c5253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:31.861751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.863394 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:31.868965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1032/2083] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:31 2022] DELETE /identity/v3/projects/5f3e6a25d7334bda93a801fd187c5253 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:31.871345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:31.873929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:31.951295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0dcebb-a7e8-4a42-9458-235bc041aa6c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:32.031276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:32.032949 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:32.033456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:32.035095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] PATH_INFO: `/v3/users/b7223ca6d33f444ea8201df1e95dff4b` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:32.036822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7223ca6d33f444ea8201df1e95dff4b)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:32.039049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:32.104522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7223ca6d33f444ea8201df1e95dff4b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.105575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7223ca6d33f444ea8201df1e95dff4b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.106545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7223ca6d33f444ea8201df1e95dff4b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.117449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7223ca6d33f444ea8201df1e95dff4b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.126721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7223ca6d33f444ea8201df1e95dff4b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.135566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:32.174883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1052/2084] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:31 2022] DELETE /identity/v3/users/b7223ca6d33f444ea8201df1e95dff4b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:32.257135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:32.259665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:32.275517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4e055-2e8c-42db-9b46-1f465dcd10db admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:32.319627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:32.321246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:32.372949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:32.373946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:32.374364 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:32.374747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] PATH_INFO: `/v3/projects/0f86c87bcf4d4beb83174e408ed14e76` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:32.376371 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f86c87bcf4d4beb83174e408ed14e76)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:32.380256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:32.435066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee86dcd-3777-442f-b383-11c0f447ac95 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:32.441700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f5fafd-ef91-4be9-a949-dc12da4f02e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:32.443552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5fafd-ef91-4be9-a949-dc12da4f02e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:32.443843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5fafd-ef91-4be9-a949-dc12da4f02e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:32.444279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5fafd-ef91-4be9-a949-dc12da4f02e8 admin admin] PATH_INFO: `/v3/users/85b3bed03dec4e82a455e78d0bc9ece8` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:32.446050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5fafd-ef91-4be9-a949-dc12da4f02e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85b3bed03dec4e82a455e78d0bc9ece8)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:32.448514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f5fafd-ef91-4be9-a949-dc12da4f02e8 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:32.465406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f86c87bcf4d4beb83174e408ed14e76', 'request_id': 'req-29d377d8-0c90-43d0-9849-dc005eed23b5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.474471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f86c87bcf4d4beb83174e408ed14e76', 'request_id': 'req-29d377d8-0c90-43d0-9849-dc005eed23b5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.484999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f86c87bcf4d4beb83174e408ed14e76', 'request_id': 'req-29d377d8-0c90-43d0-9849-dc005eed23b5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.500477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] The token cache is being invalidate because project 0f86c87bcf4d4beb83174e408ed14e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:32.500811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.501553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29d377d8-0c90-43d0-9849-dc005eed23b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.503524 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1033/2085] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:32 2022] DELETE /identity/v3/projects/0f86c87bcf4d4beb83174e408ed14e76 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:32.511036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932005f-e748-45fc-a575-5605f0c90ce1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:32.514073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932005f-e748-45fc-a575-5605f0c90ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:32.514073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932005f-e748-45fc-a575-5605f0c90ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:32.531815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-94f5fafd-ef91-4be9-a949-dc12da4f02e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85b3bed03dec4e82a455e78d0bc9ece8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.533763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-94f5fafd-ef91-4be9-a949-dc12da4f02e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85b3bed03dec4e82a455e78d0bc9ece8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.535137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-94f5fafd-ef91-4be9-a949-dc12da4f02e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85b3bed03dec4e82a455e78d0bc9ece8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.535758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f932005f-e748-45fc-a575-5605f0c90ce1 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:32.537728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f932005f-e748-45fc-a575-5605f0c90ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:32.548075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-94f5fafd-ef91-4be9-a949-dc12da4f02e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85b3bed03dec4e82a455e78d0bc9ece8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.557929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-94f5fafd-ef91-4be9-a949-dc12da4f02e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85b3bed03dec4e82a455e78d0bc9ece8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:32.586198 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1053/2086] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:32 2022] DELETE /identity/v3/users/85b3bed03dec4e82a455e78d0bc9ece8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:32.590770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745292a5-5059-4706-86f2-7940ffc8ee93 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:32.591420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745292a5-5059-4706-86f2-7940ffc8ee93 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:32.591870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745292a5-5059-4706-86f2-7940ffc8ee93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:32.614402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-745292a5-5059-4706-86f2-7940ffc8ee93 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:32.615988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-745292a5-5059-4706-86f2-7940ffc8ee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:32.625455 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1034/2087] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:32.635886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf9ff2-77b4-4a62-8fc4-a06b8c752fb4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:32.636181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf9ff2-77b4-4a62-8fc4-a06b8c752fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:32.636504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf9ff2-77b4-4a62-8fc4-a06b8c752fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:32.660158 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-21cf9ff2-77b4-4a62-8fc4-a06b8c752fb4 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:32.661971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-21cf9ff2-77b4-4a62-8fc4-a06b8c752fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:32.689985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:32.707305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1054/2088] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:32.719310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745292a5-5059-4706-86f2-7940ffc8ee93 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:32.721735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-745292a5-5059-4706-86f2-7940ffc8ee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:32.737380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:32.746994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1035/2089] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:14:32.748276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf9ff2-77b4-4a62-8fc4-a06b8c752fb4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:32.758576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf9ff2-77b4-4a62-8fc4-a06b8c752fb4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:32.764539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241bb82-ed5b-406a-b847-c67a44cd13d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:32.765310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241bb82-ed5b-406a-b847-c67a44cd13d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:32.765713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241bb82-ed5b-406a-b847-c67a44cd13d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:32.766069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241bb82-ed5b-406a-b847-c67a44cd13d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:32.766917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241bb82-ed5b-406a-b847-c67a44cd13d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:32.767948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241bb82-ed5b-406a-b847-c67a44cd13d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:32.769072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4241bb82-ed5b-406a-b847-c67a44cd13d4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:32.782287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1036/2090] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:32.789470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241bb82-ed5b-406a-b847-c67a44cd13d4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:32.801181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241bb82-ed5b-406a-b847-c67a44cd13d4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:32.807310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765b9c2-f968-4447-8f49-d6301672013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:32.808483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765b9c2-f968-4447-8f49-d6301672013c admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:32.808789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765b9c2-f968-4447-8f49-d6301672013c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:32.809057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765b9c2-f968-4447-8f49-d6301672013c admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:32.810233 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765b9c2-f968-4447-8f49-d6301672013c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:32.812329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765b9c2-f968-4447-8f49-d6301672013c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:32.818230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745292a5-5059-4706-86f2-7940ffc8ee93 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:32.823460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10350921-46e9-45d5-9b06-538c17424bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:32.825749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10350921-46e9-45d5-9b06-538c17424bcb service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:32.825749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10350921-46e9-45d5-9b06-538c17424bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:32.825749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10350921-46e9-45d5-9b06-538c17424bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:32.839653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10350921-46e9-45d5-9b06-538c17424bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:32.841448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10350921-46e9-45d5-9b06-538c17424bcb service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:32.857576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1037/2091] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:32 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:14:32.858602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765b9c2-f968-4447-8f49-d6301672013c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:32.870376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1055/2092] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:32.874609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10350921-46e9-45d5-9b06-538c17424bcb service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:32.877562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-10350921-46e9-45d5-9b06-538c17424bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:32.904574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10350921-46e9-45d5-9b06-538c17424bcb service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:32.956394 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765b9c2-f968-4447-8f49-d6301672013c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:32.963020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e9012-1bac-4fb2-866f-eef4920df1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:32.963820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e9012-1bac-4fb2-866f-eef4920df1fa admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:32.964106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e9012-1bac-4fb2-866f-eef4920df1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:32.964434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e9012-1bac-4fb2-866f-eef4920df1fa admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:32.965175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e9012-1bac-4fb2-866f-eef4920df1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:32.967285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e9012-1bac-4fb2-866f-eef4920df1fa admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:32.998770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1038/2093] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:32 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:33.001696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e9012-1bac-4fb2-866f-eef4920df1fa admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:33.006720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bd0e9012-1bac-4fb2-866f-eef4920df1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:33.009717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:33.011930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.012670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.013406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] PATH_INFO: `/v3/projects/1b36f322ee9e4a248ffeb7afe577912e` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.015363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b36f322ee9e4a248ffeb7afe577912e)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:33.018254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:33.024248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e9012-1bac-4fb2-866f-eef4920df1fa admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:33.032107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4c317-a6c4-4777-8087-7d8c2538a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:33.033549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c317-a6c4-4777-8087-7d8c2538a542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.034032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c317-a6c4-4777-8087-7d8c2538a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.034531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4c317-a6c4-4777-8087-7d8c2538a542 admin admin] PATH_INFO: `/v3/users/88c87225635d4af89d1a9ba046064d28` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.036622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4c317-a6c4-4777-8087-7d8c2538a542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c87225635d4af89d1a9ba046064d28)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:33.040447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4c317-a6c4-4777-8087-7d8c2538a542 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:33.105997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b36f322ee9e4a248ffeb7afe577912e', 'request_id': 'req-0b0334b6-9a8d-4587-9d99-74438f66a5e2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.118801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b36f322ee9e4a248ffeb7afe577912e', 'request_id': 'req-0b0334b6-9a8d-4587-9d99-74438f66a5e2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.123325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c9f4c317-a6c4-4777-8087-7d8c2538a542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c87225635d4af89d1a9ba046064d28'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.124550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c9f4c317-a6c4-4777-8087-7d8c2538a542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c87225635d4af89d1a9ba046064d28'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.124951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b36f322ee9e4a248ffeb7afe577912e', 'request_id': 'req-0b0334b6-9a8d-4587-9d99-74438f66a5e2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.125312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c9f4c317-a6c4-4777-8087-7d8c2538a542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c87225635d4af89d1a9ba046064d28'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.136861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c9f4c317-a6c4-4777-8087-7d8c2538a542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c87225635d4af89d1a9ba046064d28'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.139454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] The token cache is being invalidate because project 1b36f322ee9e4a248ffeb7afe577912e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:33.139748 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.140446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.145694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1056/2094] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:32 2022] DELETE /identity/v3/projects/1b36f322ee9e4a248ffeb7afe577912e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:33.145694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:33.146865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:33.155147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c9f4c317-a6c4-4777-8087-7d8c2538a542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c87225635d4af89d1a9ba046064d28'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.159815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:33.172705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1039/2095] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:32 2022] DELETE /identity/v3/users/88c87225635d4af89d1a9ba046064d28 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:33.174669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc540efe-c7c1-4289-8e13-06a1f09de4e4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.175401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc540efe-c7c1-4289-8e13-06a1f09de4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.176076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc540efe-c7c1-4289-8e13-06a1f09de4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.215968 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-dc540efe-c7c1-4289-8e13-06a1f09de4e4 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:33.224307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dc540efe-c7c1-4289-8e13-06a1f09de4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:33.241642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:33.274181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0334b6-9a8d-4587-9d99-74438f66a5e2 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:33.352475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a20ab-8fa4-4f73-a3f5-d0c99955ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:33.353233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a20ab-8fa4-4f73-a3f5-d0c99955ed93 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.353592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a20ab-8fa4-4f73-a3f5-d0c99955ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.354030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a20ab-8fa4-4f73-a3f5-d0c99955ed93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.354798 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a20ab-8fa4-4f73-a3f5-d0c99955ed93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:33.356522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a20ab-8fa4-4f73-a3f5-d0c99955ed93 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:33.364075 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1040/2096] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:33.365622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc540efe-c7c1-4289-8e13-06a1f09de4e4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:33.369700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1057/2097] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:33.371930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142f48-6de3-4f43-94c8-1689946f331e None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.372292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142f48-6de3-4f43-94c8-1689946f331e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.372646 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142f48-6de3-4f43-94c8-1689946f331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.374721 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dc540efe-c7c1-4289-8e13-06a1f09de4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:33.392043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc540efe-c7c1-4289-8e13-06a1f09de4e4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:33.392424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e4142f48-6de3-4f43-94c8-1689946f331e None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:33.393519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e4142f48-6de3-4f43-94c8-1689946f331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:33.403049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:33.404296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.404909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.405352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] PATH_INFO: `/v3/projects/702f2f3c729b4a45a09d19db307c633c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.407331 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1058/2098] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:33.408187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=702f2f3c729b4a45a09d19db307c633c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:33.408320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142f48-6de3-4f43-94c8-1689946f331e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:33.410261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:33.420641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142f48-6de3-4f43-94c8-1689946f331e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:33.425991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014edc2-638f-4ba5-ac36-9a31dacc312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:33.427291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014edc2-638f-4ba5-ac36-9a31dacc312b admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.427582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014edc2-638f-4ba5-ac36-9a31dacc312b admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.427868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014edc2-638f-4ba5-ac36-9a31dacc312b admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.428733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014edc2-638f-4ba5-ac36-9a31dacc312b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:33.430384 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014edc2-638f-4ba5-ac36-9a31dacc312b admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:33.443024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1059/2099] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:33.444072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014edc2-638f-4ba5-ac36-9a31dacc312b admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:33.459793 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014edc2-638f-4ba5-ac36-9a31dacc312b admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:33.478263 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '702f2f3c729b4a45a09d19db307c633c', 'request_id': 'req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.486529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '702f2f3c729b4a45a09d19db307c633c', 'request_id': 'req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.499767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '702f2f3c729b4a45a09d19db307c633c', 'request_id': 'req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.512719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] The token cache is being invalidate because project 702f2f3c729b4a45a09d19db307c633c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:33.513016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.513722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.515331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1041/2100] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:33 2022] DELETE /identity/v3/projects/702f2f3c729b4a45a09d19db307c633c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:33.516084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:33.517423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:33.531723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b10ce-fc68-4235-996c-50ba7ae696f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:33.532427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b10ce-fc68-4235-996c-50ba7ae696f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.532720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b10ce-fc68-4235-996c-50ba7ae696f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.533000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b10ce-fc68-4235-996c-50ba7ae696f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.533745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b10ce-fc68-4235-996c-50ba7ae696f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:33.534149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b10ce-fc68-4235-996c-50ba7ae696f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:33.536540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b10ce-fc68-4235-996c-50ba7ae696f6 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:33.550565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1060/2101] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:33.551418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b10ce-fc68-4235-996c-50ba7ae696f6 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:33.553896 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a63b10ce-fc68-4235-996c-50ba7ae696f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:33.566951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b10ce-fc68-4235-996c-50ba7ae696f6 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:33.572299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:33.573183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.573473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.573759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] PATH_INFO: `/v3/users/92f17a71dcdc4663a51ef8ca291441f3` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.575102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f17a71dcdc4663a51ef8ca291441f3)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:33.577152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:33.596265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fd2be-dc85-4c84-9987-4ee037cad9d4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:33.602232 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ee7b3-d446-45a0-9d59-539f9abf29bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:33.603230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ee7b3-d446-45a0-9d59-539f9abf29bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.603714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ee7b3-d446-45a0-9d59-539f9abf29bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.604034 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ee7b3-d446-45a0-9d59-539f9abf29bd admin admin] PATH_INFO: `/v3/projects/6038257a00c649f2a65f55abb71a166b/users/758049eae6b343689ae5f3621ae137d1/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.623146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ee7b3-d446-45a0-9d59-539f9abf29bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6038257a00c649f2a65f55abb71a166b, user_id=758049eae6b343689ae5f3621ae137d1, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:33.625871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ee7b3-d446-45a0-9d59-539f9abf29bd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:33.629760 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f17a71dcdc4663a51ef8ca291441f3'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.630809 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f17a71dcdc4663a51ef8ca291441f3'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.631814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f17a71dcdc4663a51ef8ca291441f3'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.638268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:33.640545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1042/2102] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:33 2022] PUT /identity/v3/projects/6038257a00c649f2a65f55abb71a166b/users/758049eae6b343689ae5f3621ae137d1/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:33.640673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f17a71dcdc4663a51ef8ca291441f3'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.641379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ee7b3-d446-45a0-9d59-539f9abf29bd admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:33.643035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-000ee7b3-d446-45a0-9d59-539f9abf29bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:33.648649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:33.660181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f17a71dcdc4663a51ef8ca291441f3'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.682043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1061/2103] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:33 2022] DELETE /identity/v3/users/92f17a71dcdc4663a51ef8ca291441f3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:33.682043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:33.685148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:33.719071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ee7b3-d446-45a0-9d59-539f9abf29bd admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:33.750441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9638a0-e99a-4503-8790-e4c5317a2776 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:33.755010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:33.755879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.756417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.756693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] PATH_INFO: `/v3/users/54e9124013ff4cdcb871c56482cb2b02` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.758207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e9124013ff4cdcb871c56482cb2b02)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:33.760529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:33.790508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:33.791551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.791698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.791935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] PATH_INFO: `/v3/projects/4c5002ba88804a048f3e7d9b20bcf39c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.793169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c5002ba88804a048f3e7d9b20bcf39c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:33.795160 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:33.811965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e9124013ff4cdcb871c56482cb2b02'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.812943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e9124013ff4cdcb871c56482cb2b02'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.813573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e9124013ff4cdcb871c56482cb2b02'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.821030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e9124013ff4cdcb871c56482cb2b02'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.828553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e9124013ff4cdcb871c56482cb2b02'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.843000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c5002ba88804a048f3e7d9b20bcf39c', 'request_id': 'req-936d0fdb-a887-456f-912c-aa64a0010999'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.846775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1062/2104] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:33 2022] DELETE /identity/v3/users/54e9124013ff4cdcb871c56482cb2b02 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:33.847575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:33.849491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:33.852429 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c5002ba88804a048f3e7d9b20bcf39c', 'request_id': 'req-936d0fdb-a887-456f-912c-aa64a0010999'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.867347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c5002ba88804a048f3e7d9b20bcf39c', 'request_id': 'req-936d0fdb-a887-456f-912c-aa64a0010999'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.884259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] The token cache is being invalidate because project 4c5002ba88804a048f3e7d9b20bcf39c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:33.884627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.885979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-936d0fdb-a887-456f-912c-aa64a0010999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:33.887211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1043/2105] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:33 2022] DELETE /identity/v3/projects/4c5002ba88804a048f3e7d9b20bcf39c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:33.888644 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe34ea-54e4-4f64-920a-1c5699ae098e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.888873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe34ea-54e4-4f64-920a-1c5699ae098e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.889130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe34ea-54e4-4f64-920a-1c5699ae098e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.920364 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-20fe34ea-54e4-4f64-920a-1c5699ae098e None None] MFA Rules not processed for user `758049eae6b343689ae5f3621ae137d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:33.922021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-20fe34ea-54e4-4f64-920a-1c5699ae098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:33.938004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:33.959204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b146bf-633f-48f5-a2dc-bb9c2d20f7f5 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:33.964344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b845aaa-4d9d-471f-84d8-1b1a8ead779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:33.965465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845aaa-4d9d-471f-84d8-1b1a8ead779d admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.965465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845aaa-4d9d-471f-84d8-1b1a8ead779d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.965644 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845aaa-4d9d-471f-84d8-1b1a8ead779d admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:33.966371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b845aaa-4d9d-471f-84d8-1b1a8ead779d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:33.968324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b845aaa-4d9d-471f-84d8-1b1a8ead779d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:33.972361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:33.998513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1063/2106] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:33 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:33.998735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429172b-d46f-4335-87a2-94bcc3ac457f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:33.999125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429172b-d46f-4335-87a2-94bcc3ac457f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:33.999340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429172b-d46f-4335-87a2-94bcc3ac457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.022454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-1429172b-d46f-4335-87a2-94bcc3ac457f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:34.023563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1429172b-d46f-4335-87a2-94bcc3ac457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.030627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1044/2107] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:34.031621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe34ea-54e4-4f64-920a-1c5699ae098e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.033166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-20fe34ea-54e4-4f64-920a-1c5699ae098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.057414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe34ea-54e4-4f64-920a-1c5699ae098e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.102251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1064/2108] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:34.103487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429172b-d46f-4335-87a2-94bcc3ac457f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.106423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1429172b-d46f-4335-87a2-94bcc3ac457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.120731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429172b-d46f-4335-87a2-94bcc3ac457f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.125568 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f05ba-40ca-45a0-8493-f25d21d387a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.126384 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f05ba-40ca-45a0-8493-f25d21d387a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.126779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f05ba-40ca-45a0-8493-f25d21d387a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.127074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f05ba-40ca-45a0-8493-f25d21d387a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.127781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f05ba-40ca-45a0-8493-f25d21d387a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.129047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.130371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f05ba-40ca-45a0-8493-f25d21d387a3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:34.130770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.131375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.131597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] PATH_INFO: `/v3/users/6f5f844f12c14eeda8c00bdc0de8ddff` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.133339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5f844f12c14eeda8c00bdc0de8ddff)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.135480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:34.157238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1065/2109] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:34 2022] POST /identity/v3/users => generated 291 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:34.158428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f05ba-40ca-45a0-8493-f25d21d387a3 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.164292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-772f05ba-40ca-45a0-8493-f25d21d387a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.185444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f05ba-40ca-45a0-8493-f25d21d387a3 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.191649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5993981-fee7-4b87-a25a-ec6186cafc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.192905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993981-fee7-4b87-a25a-ec6186cafc69 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.193250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993981-fee7-4b87-a25a-ec6186cafc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.193545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993981-fee7-4b87-a25a-ec6186cafc69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.194273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5993981-fee7-4b87-a25a-ec6186cafc69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.196316 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5993981-fee7-4b87-a25a-ec6186cafc69 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:34.228184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5f844f12c14eeda8c00bdc0de8ddff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.228895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5f844f12c14eeda8c00bdc0de8ddff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.229532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5f844f12c14eeda8c00bdc0de8ddff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.232527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1066/2110] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:34 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:34.234247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5993981-fee7-4b87-a25a-ec6186cafc69 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.237009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e5993981-fee7-4b87-a25a-ec6186cafc69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.237929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5f844f12c14eeda8c00bdc0de8ddff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.251064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5f844f12c14eeda8c00bdc0de8ddff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.266603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1045/2111] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:34 2022] DELETE /identity/v3/users/6f5f844f12c14eeda8c00bdc0de8ddff => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:34.267592 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.269119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.318502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5993981-fee7-4b87-a25a-ec6186cafc69 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.351692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:34.381829 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19437129-80f9-40bd-86de-97ed8db097fa admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.398174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d44730-e2dc-41d9-81ad-c1b938bd0358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.399358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44730-e2dc-41d9-81ad-c1b938bd0358 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.400191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44730-e2dc-41d9-81ad-c1b938bd0358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.400576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44730-e2dc-41d9-81ad-c1b938bd0358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.402258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d44730-e2dc-41d9-81ad-c1b938bd0358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.405064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d44730-e2dc-41d9-81ad-c1b938bd0358 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:34.419927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde91687-326b-4aa6-8877-d7f83e51bccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.420604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde91687-326b-4aa6-8877-d7f83e51bccc service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.420993 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde91687-326b-4aa6-8877-d7f83e51bccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.421459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1046/2112] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:34.421836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde91687-326b-4aa6-8877-d7f83e51bccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.422656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d44730-e2dc-41d9-81ad-c1b938bd0358 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.424069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cde91687-326b-4aa6-8877-d7f83e51bccc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.424649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-53d44730-e2dc-41d9-81ad-c1b938bd0358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.438127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:34.438994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d44730-e2dc-41d9-81ad-c1b938bd0358 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.443463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde91687-326b-4aa6-8877-d7f83e51bccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.446196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde91687-326b-4aa6-8877-d7f83e51bccc service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:34.448259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.449157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.449409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.449686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] PATH_INFO: `/v3/projects/5091e35d38e84406897af360a52cb43c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.455120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5091e35d38e84406897af360a52cb43c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.457095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:34.465097 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1067/2113] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:34.466009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde91687-326b-4aa6-8877-d7f83e51bccc service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.468305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cde91687-326b-4aa6-8877-d7f83e51bccc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.491111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde91687-326b-4aa6-8877-d7f83e51bccc service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.496472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455ec5f-9fd0-46a4-992a-c2c4ce216152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.497163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ec5f-9fd0-46a4-992a-c2c4ce216152 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.497508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ec5f-9fd0-46a4-992a-c2c4ce216152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.498252 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455ec5f-9fd0-46a4-992a-c2c4ce216152 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.498721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455ec5f-9fd0-46a4-992a-c2c4ce216152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.502474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455ec5f-9fd0-46a4-992a-c2c4ce216152 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:34.536890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1068/2114] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:34 2022] POST /identity/v3/users => generated 290 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:34.538080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455ec5f-9fd0-46a4-992a-c2c4ce216152 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.552233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455ec5f-9fd0-46a4-992a-c2c4ce216152 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.555940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5091e35d38e84406897af360a52cb43c', 'request_id': 'req-23433264-a411-4e4a-a027-75c775098121'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.564850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5091e35d38e84406897af360a52cb43c', 'request_id': 'req-23433264-a411-4e4a-a027-75c775098121'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.580826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5091e35d38e84406897af360a52cb43c', 'request_id': 'req-23433264-a411-4e4a-a027-75c775098121'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.597372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] The token cache is being invalidate because project 5091e35d38e84406897af360a52cb43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:34.597733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.598718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.600988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1047/2115] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:34 2022] DELETE /identity/v3/projects/5091e35d38e84406897af360a52cb43c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:34.601929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.604580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.647452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b0808-d60a-4a19-9c16-13ae5bde12f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.648173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b0808-d60a-4a19-9c16-13ae5bde12f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.648451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b0808-d60a-4a19-9c16-13ae5bde12f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.648734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b0808-d60a-4a19-9c16-13ae5bde12f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.649488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b0808-d60a-4a19-9c16-13ae5bde12f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.651471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b0808-d60a-4a19-9c16-13ae5bde12f0 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:34.670004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1069/2116] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:34.670004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b0808-d60a-4a19-9c16-13ae5bde12f0 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.671689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-955b0808-d60a-4a19-9c16-13ae5bde12f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.689274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b0808-d60a-4a19-9c16-13ae5bde12f0 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.695942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.696833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.697121 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.697398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] PATH_INFO: `/v3/users/a204e27815644c91ab4a61031f1ef0a4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.698710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a204e27815644c91ab4a61031f1ef0a4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.700762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:34.717813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23433264-a411-4e4a-a027-75c775098121 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.723605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef72ca8-f7be-42ec-bb98-d82148a7d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.724598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72ca8-f7be-42ec-bb98-d82148a7d024 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.724956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72ca8-f7be-42ec-bb98-d82148a7d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.725728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef72ca8-f7be-42ec-bb98-d82148a7d024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.726567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef72ca8-f7be-42ec-bb98-d82148a7d024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.728308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef72ca8-f7be-42ec-bb98-d82148a7d024 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:34.748688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1048/2117] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:34.748688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef72ca8-f7be-42ec-bb98-d82148a7d024 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.749288 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6ef72ca8-f7be-42ec-bb98-d82148a7d024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.767605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef72ca8-f7be-42ec-bb98-d82148a7d024 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.773850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.774817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.775108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.775387 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] PATH_INFO: `/v3/projects/fbcc6432d3b04fafa31d8ec4d2e40ac8` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.776784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a204e27815644c91ab4a61031f1ef0a4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.777504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbcc6432d3b04fafa31d8ec4d2e40ac8)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.777615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a204e27815644c91ab4a61031f1ef0a4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.778268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a204e27815644c91ab4a61031f1ef0a4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.780290 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:34.789416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a204e27815644c91ab4a61031f1ef0a4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.800539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a204e27815644c91ab4a61031f1ef0a4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.850414 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbcc6432d3b04fafa31d8ec4d2e40ac8', 'request_id': 'req-6a137af2-8ffe-4e56-b90d-d7af836e72a5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.851290 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1070/2118] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:34 2022] DELETE /identity/v3/users/a204e27815644c91ab4a61031f1ef0a4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:34.854066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.855668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.866967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbcc6432d3b04fafa31d8ec4d2e40ac8', 'request_id': 'req-6a137af2-8ffe-4e56-b90d-d7af836e72a5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.869302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:34.881312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbcc6432d3b04fafa31d8ec4d2e40ac8', 'request_id': 'req-6a137af2-8ffe-4e56-b90d-d7af836e72a5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.899831 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] The token cache is being invalidate because project fbcc6432d3b04fafa31d8ec4d2e40ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:34.900207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.901311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:34.902885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1049/2119] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:34 2022] DELETE /identity/v3/projects/fbcc6432d3b04fafa31d8ec4d2e40ac8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:34.906993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:34.906993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:34.925984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:34.950566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020f094-d7e0-440e-8820-05a8a7f4f275 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:34.958328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5d9da-8061-4440-a33a-fa2554021a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:34.959557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5d9da-8061-4440-a33a-fa2554021a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:34.960248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5d9da-8061-4440-a33a-fa2554021a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:34.960682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5d9da-8061-4440-a33a-fa2554021a75 admin admin] PATH_INFO: `/v3/projects/ec4ffe63b69d4a2794735aa6c5acc67d/users/d0038605677f4fb4a9a92ecdf14bf483/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:34.980195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5d9da-8061-4440-a33a-fa2554021a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec4ffe63b69d4a2794735aa6c5acc67d, user_id=d0038605677f4fb4a9a92ecdf14bf483, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:34.983706 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5d9da-8061-4440-a33a-fa2554021a75 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.002743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a137af2-8ffe-4e56-b90d-d7af836e72a5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.007089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1071/2120] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:34 2022] PUT /identity/v3/projects/ec4ffe63b69d4a2794735aa6c5acc67d/users/d0038605677f4fb4a9a92ecdf14bf483/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:35.017777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5143-e64f-4109-ad72-20bd0f855efd None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.018069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5143-e64f-4109-ad72-20bd0f855efd None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.018376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ea5143-e64f-4109-ad72-20bd0f855efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.041256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e4ea5143-e64f-4109-ad72-20bd0f855efd None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:35.042716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e4ea5143-e64f-4109-ad72-20bd0f855efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.095142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37667c34-ea5d-445c-b817-c1eaf1285c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.096136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667c34-ea5d-445c-b817-c1eaf1285c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.096332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667c34-ea5d-445c-b817-c1eaf1285c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.096663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37667c34-ea5d-445c-b817-c1eaf1285c3f admin admin] PATH_INFO: `/v3/projects/2e7f4d0d773c4b24ad6a1873ac567167/users/cd8eeb9232c347c2a24fd3d1229eaefb/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.113789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37667c34-ea5d-445c-b817-c1eaf1285c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7f4d0d773c4b24ad6a1873ac567167, user_id=cd8eeb9232c347c2a24fd3d1229eaefb, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.117160 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37667c34-ea5d-445c-b817-c1eaf1285c3f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.122475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1072/2121] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:35.123980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5143-e64f-4109-ad72-20bd0f855efd None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.125801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e4ea5143-e64f-4109-ad72-20bd0f855efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.139346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ea5143-e64f-4109-ad72-20bd0f855efd None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.149843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1050/2122] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:34 2022] PUT /identity/v3/projects/2e7f4d0d773c4b24ad6a1873ac567167/users/cd8eeb9232c347c2a24fd3d1229eaefb/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:35.151857 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7637e5-2e24-4fdf-9eee-768b012f0587 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.152225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7637e5-2e24-4fdf-9eee-768b012f0587 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.152602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7637e5-2e24-4fdf-9eee-768b012f0587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.183343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ba7637e5-2e24-4fdf-9eee-768b012f0587 None None] MFA Rules not processed for user `d0038605677f4fb4a9a92ecdf14bf483`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:35.184624 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ba7637e5-2e24-4fdf-9eee-768b012f0587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.218649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.219540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.219829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.220117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] PATH_INFO: `/v3/projects/3d2d3098c7c34459ad0bd622c4b183f7` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.221368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2d3098c7c34459ad0bd622c4b183f7)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.224232 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.267771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1051/2123] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:35.269160 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d5886-6dbd-4e3a-9c88-bf7619bd7c36 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.269526 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d5886-6dbd-4e3a-9c88-bf7619bd7c36 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.269874 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d5886-6dbd-4e3a-9c88-bf7619bd7c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.280358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2d3098c7c34459ad0bd622c4b183f7', 'request_id': 'req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:35.284143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:35.287978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2d3098c7c34459ad0bd622c4b183f7', 'request_id': 'req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:35.292638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-db6d5886-6dbd-4e3a-9c88-bf7619bd7c36 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:35.294351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2d3098c7c34459ad0bd622c4b183f7', 'request_id': 'req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:35.294558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-db6d5886-6dbd-4e3a-9c88-bf7619bd7c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.305601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:35.314145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] The token cache is being invalidate because project 3d2d3098c7c34459ad0bd622c4b183f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:35.314939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:35.316498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:35.319518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1073/2124] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:35 2022] DELETE /identity/v3/projects/3d2d3098c7c34459ad0bd622c4b183f7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:35.320794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.322615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.377680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1052/2125] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:35.378657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d5886-6dbd-4e3a-9c88-bf7619bd7c36 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.381216 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-db6d5886-6dbd-4e3a-9c88-bf7619bd7c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.399331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d5886-6dbd-4e3a-9c88-bf7619bd7c36 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.404790 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.405667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.405959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.406398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] PATH_INFO: `/v3/projects/bfdcc9d01e7b473aa70549d501a91c10` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.407554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfdcc9d01e7b473aa70549d501a91c10)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.407893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edc5d8-1b5a-4166-9200-2c40fdb66cd5 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.409599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.413531 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da998414-5a5a-4f2e-89c7-c73e3c77d4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.414405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da998414-5a5a-4f2e-89c7-c73e3c77d4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.414525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da998414-5a5a-4f2e-89c7-c73e3c77d4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.414784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da998414-5a5a-4f2e-89c7-c73e3c77d4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.415521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da998414-5a5a-4f2e-89c7-c73e3c77d4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.417179 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da998414-5a5a-4f2e-89c7-c73e3c77d4ea admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.433906 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1074/2126] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:35.433906 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da998414-5a5a-4f2e-89c7-c73e3c77d4ea admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.434594 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-da998414-5a5a-4f2e-89c7-c73e3c77d4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.447742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da998414-5a5a-4f2e-89c7-c73e3c77d4ea admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.453372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7f13a-1c31-466c-b8c8-3a32bd00e354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.454370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7f13a-1c31-466c-b8c8-3a32bd00e354 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.454857 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7f13a-1c31-466c-b8c8-3a32bd00e354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.455510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7f13a-1c31-466c-b8c8-3a32bd00e354 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.456099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7f13a-1c31-466c-b8c8-3a32bd00e354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.458946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7f13a-1c31-466c-b8c8-3a32bd00e354 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.474099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdcc9d01e7b473aa70549d501a91c10', 'request_id': 'req-99f72434-0294-49f7-b001-9be57ce11d17'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:35.482312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdcc9d01e7b473aa70549d501a91c10', 'request_id': 'req-99f72434-0294-49f7-b001-9be57ce11d17'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:35.498215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1075/2127] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:35.498215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94283f4a-b4a4-44fc-a5fb-eab519aa1c30 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.498215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94283f4a-b4a4-44fc-a5fb-eab519aa1c30 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.498215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94283f4a-b4a4-44fc-a5fb-eab519aa1c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.498598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdcc9d01e7b473aa70549d501a91c10', 'request_id': 'req-99f72434-0294-49f7-b001-9be57ce11d17'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:35.507824 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] The token cache is being invalidate because project bfdcc9d01e7b473aa70549d501a91c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:35.508228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:35.508959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:35.510971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1053/2128] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:35 2022] DELETE /identity/v3/projects/bfdcc9d01e7b473aa70549d501a91c10 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:35.515094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.515651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-94283f4a-b4a4-44fc-a5fb-eab519aa1c30 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:35.516584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.518331 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-94283f4a-b4a4-44fc-a5fb-eab519aa1c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.602485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1076/2129] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:35.602669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f72434-0294-49f7-b001-9be57ce11d17 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.602772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94283f4a-b4a4-44fc-a5fb-eab519aa1c30 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.602772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-94283f4a-b4a4-44fc-a5fb-eab519aa1c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.602935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660dbdf-dfc3-47bb-a31e-af6c227fac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.603373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660dbdf-dfc3-47bb-a31e-af6c227fac94 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.603670 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660dbdf-dfc3-47bb-a31e-af6c227fac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.603954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660dbdf-dfc3-47bb-a31e-af6c227fac94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.604696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660dbdf-dfc3-47bb-a31e-af6c227fac94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:35.605008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660dbdf-dfc3-47bb-a31e-af6c227fac94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.606767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660dbdf-dfc3-47bb-a31e-af6c227fac94 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.613587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94283f4a-b4a4-44fc-a5fb-eab519aa1c30 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.619085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27435548-35b5-4e8d-8234-16d24c582615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.620076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27435548-35b5-4e8d-8234-16d24c582615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.620362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27435548-35b5-4e8d-8234-16d24c582615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.620645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27435548-35b5-4e8d-8234-16d24c582615 admin admin] PATH_INFO: `/v3/projects/2e7f4d0d773c4b24ad6a1873ac567167/users/cd8eeb9232c347c2a24fd3d1229eaefb/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.620758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1054/2130] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:35.624934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660dbdf-dfc3-47bb-a31e-af6c227fac94 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.624934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d660dbdf-dfc3-47bb-a31e-af6c227fac94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.626421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27435548-35b5-4e8d-8234-16d24c582615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7f4d0d773c4b24ad6a1873ac567167, user_id=cd8eeb9232c347c2a24fd3d1229eaefb, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.630118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27435548-35b5-4e8d-8234-16d24c582615 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.639479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660dbdf-dfc3-47bb-a31e-af6c227fac94 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.646870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1077/2131] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:35 2022] PUT /identity/v3/projects/2e7f4d0d773c4b24ad6a1873ac567167/users/cd8eeb9232c347c2a24fd3d1229eaefb/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:35.656477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9a4f3-5b64-4b57-8462-63fb57baba38 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.656477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9a4f3-5b64-4b57-8462-63fb57baba38 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.659928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9a4f3-5b64-4b57-8462-63fb57baba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.674708 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:35.686368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-17b9a4f3-5b64-4b57-8462-63fb57baba38 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:35.688586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-17b9a4f3-5b64-4b57-8462-63fb57baba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.719528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39bad0-04f6-49f1-ae3f-88f486520d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.720217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39bad0-04f6-49f1-ae3f-88f486520d06 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.720506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39bad0-04f6-49f1-ae3f-88f486520d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.720784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39bad0-04f6-49f1-ae3f-88f486520d06 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.721491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39bad0-04f6-49f1-ae3f-88f486520d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.723587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f39bad0-04f6-49f1-ae3f-88f486520d06 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.749392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1055/2132] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:35.752433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955038cc-92b9-429c-a9bf-56bff186ad07 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.752856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955038cc-92b9-429c-a9bf-56bff186ad07 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.753138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955038cc-92b9-429c-a9bf-56bff186ad07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.765434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1078/2133] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:35.765434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9a4f3-5b64-4b57-8462-63fb57baba38 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.771542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:35.776566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-955038cc-92b9-429c-a9bf-56bff186ad07 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:35.777972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-955038cc-92b9-429c-a9bf-56bff186ad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.780154 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9a4f3-5b64-4b57-8462-63fb57baba38 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.787873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102316fd-6f6a-47b4-a1f9-7fb464a32f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.789057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1056/2134] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:35.789437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102316fd-6f6a-47b4-a1f9-7fb464a32f3f admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.790038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102316fd-6f6a-47b4-a1f9-7fb464a32f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.790536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102316fd-6f6a-47b4-a1f9-7fb464a32f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.790641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbbcca-212e-42f5-a089-5013a81c541e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.790946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbbcca-212e-42f5-a089-5013a81c541e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.791390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbbcca-212e-42f5-a089-5013a81c541e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.791896 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102316fd-6f6a-47b4-a1f9-7fb464a32f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.794554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102316fd-6f6a-47b4-a1f9-7fb464a32f3f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.825523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1079/2135] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:35.826545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102316fd-6f6a-47b4-a1f9-7fb464a32f3f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.830335 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ccbbbcca-212e-42f5-a089-5013a81c541e None None] MFA Rules not processed for user `cd8eeb9232c347c2a24fd3d1229eaefb`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:35.831731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ccbbbcca-212e-42f5-a089-5013a81c541e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.916494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102316fd-6f6a-47b4-a1f9-7fb464a32f3f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.922349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212d356-c4a7-4a90-9195-50292c7d37e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.923117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212d356-c4a7-4a90-9195-50292c7d37e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.923468 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212d356-c4a7-4a90-9195-50292c7d37e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.923812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212d356-c4a7-4a90-9195-50292c7d37e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.924628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212d356-c4a7-4a90-9195-50292c7d37e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.926884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212d356-c4a7-4a90-9195-50292c7d37e1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.938353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1080/2136] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:35.944236 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1057/2137] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:35.944236 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbbcca-212e-42f5-a089-5013a81c541e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.944486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a9a43-18e2-45b2-83df-044989371aa4 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.944672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a9a43-18e2-45b2-83df-044989371aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.945021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a9a43-18e2-45b2-83df-044989371aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.954769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbbcca-212e-42f5-a089-5013a81c541e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.959974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae96b7-465e-4fc2-9795-c766e4f7c336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.960769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae96b7-465e-4fc2-9795-c766e4f7c336 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.961097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae96b7-465e-4fc2-9795-c766e4f7c336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.961380 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae96b7-465e-4fc2-9795-c766e4f7c336 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.962117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae96b7-465e-4fc2-9795-c766e4f7c336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:35.962456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae96b7-465e-4fc2-9795-c766e4f7c336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.964077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae96b7-465e-4fc2-9795-c766e4f7c336 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.965449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-777a9a43-18e2-45b2-83df-044989371aa4 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:35.966824 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-777a9a43-18e2-45b2-83df-044989371aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:35.975489 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1081/2138] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:35.976551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a9a43-18e2-45b2-83df-044989371aa4 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.981400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1058/2139] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:35.981400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae96b7-465e-4fc2-9795-c766e4f7c336 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:35.987259 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a9a43-18e2-45b2-83df-044989371aa4 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.992848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae96b7-465e-4fc2-9795-c766e4f7c336 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:35.993874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166355c-e355-40ef-8b31-192e133ac78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.994391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166355c-e355-40ef-8b31-192e133ac78a admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:35.994744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166355c-e355-40ef-8b31-192e133ac78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:35.995092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166355c-e355-40ef-8b31-192e133ac78a admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:35.995800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166355c-e355-40ef-8b31-192e133ac78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:35.997873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166355c-e355-40ef-8b31-192e133ac78a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:35.999412 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009b09c-c9dd-4cf9-ad0d-28174ddef772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:35.999840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009b09c-c9dd-4cf9-ad0d-28174ddef772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.000191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009b09c-c9dd-4cf9-ad0d-28174ddef772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.000546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009b09c-c9dd-4cf9-ad0d-28174ddef772 admin admin] PATH_INFO: `/v3/projects/47397cfc0b884acb9b4b537dc10bbb1b/users/9445f593d81640c7ad7fa24adb0234af/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.020426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009b09c-c9dd-4cf9-ad0d-28174ddef772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47397cfc0b884acb9b4b537dc10bbb1b, user_id=9445f593d81640c7ad7fa24adb0234af, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.021979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1082/2140] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:35 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:36.022910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166355c-e355-40ef-8b31-192e133ac78a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.023552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009b09c-c9dd-4cf9-ad0d-28174ddef772 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.025772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2166355c-e355-40ef-8b31-192e133ac78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:36.038809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1059/2141] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:35 2022] PUT /identity/v3/projects/47397cfc0b884acb9b4b537dc10bbb1b/users/9445f593d81640c7ad7fa24adb0234af/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:36.039839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009b09c-c9dd-4cf9-ad0d-28174ddef772 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.093185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166355c-e355-40ef-8b31-192e133ac78a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.100720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:36.107403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009b09c-c9dd-4cf9-ad0d-28174ddef772 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.113666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a25265-2ccf-42f6-ba46-677867f10dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.115030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a25265-2ccf-42f6-ba46-677867f10dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.115438 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a25265-2ccf-42f6-ba46-677867f10dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.115699 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a25265-2ccf-42f6-ba46-677867f10dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.116436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a25265-2ccf-42f6-ba46-677867f10dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:36.116745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a25265-2ccf-42f6-ba46-677867f10dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.118396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a25265-2ccf-42f6-ba46-677867f10dd9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.140523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1060/2142] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:36.140523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a25265-2ccf-42f6-ba46-677867f10dd9 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.151818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a25265-2ccf-42f6-ba46-677867f10dd9 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.152412 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeef76-b256-4c4a-b975-4c519d27a7cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.153084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeef76-b256-4c4a-b975-4c519d27a7cc service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.153374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeef76-b256-4c4a-b975-4c519d27a7cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.153655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdeef76-b256-4c4a-b975-4c519d27a7cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.156679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930cab3-d936-4531-b53d-4d09c6e10c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.157327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930cab3-d936-4531-b53d-4d09c6e10c01 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.157608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930cab3-d936-4531-b53d-4d09c6e10c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.157888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930cab3-d936-4531-b53d-4d09c6e10c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.158614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930cab3-d936-4531-b53d-4d09c6e10c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.160521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930cab3-d936-4531-b53d-4d09c6e10c01 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.175129 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:36.188622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1061/2143] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:36 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:36.189613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930cab3-d936-4531-b53d-4d09c6e10c01 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.235141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdeef76-b256-4c4a-b975-4c519d27a7cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.236576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdeef76-b256-4c4a-b975-4c519d27a7cc service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.247238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1083/2144] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:36 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:36.248039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeef76-b256-4c4a-b975-4c519d27a7cc service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.258585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdeef76-b256-4c4a-b975-4c519d27a7cc service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.259197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930cab3-d936-4531-b53d-4d09c6e10c01 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.263345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b383d1-aaea-4522-aca3-0caf9aaf6b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.264012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b383d1-aaea-4522-aca3-0caf9aaf6b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.264218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1c368-a93a-4881-8a1e-a6c57249df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.264334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b383d1-aaea-4522-aca3-0caf9aaf6b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.264560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b383d1-aaea-4522-aca3-0caf9aaf6b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.264896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c368-a93a-4881-8a1e-a6c57249df12 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.265184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c368-a93a-4881-8a1e-a6c57249df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.265292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b383d1-aaea-4522-aca3-0caf9aaf6b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.265456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1c368-a93a-4881-8a1e-a6c57249df12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.266230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1c368-a93a-4881-8a1e-a6c57249df12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.266895 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b383d1-aaea-4522-aca3-0caf9aaf6b7f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.267820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1c368-a93a-4881-8a1e-a6c57249df12 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.279715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1084/2145] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:36.283382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b383d1-aaea-4522-aca3-0caf9aaf6b7f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.283504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1062/2146] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:36.283504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1c368-a93a-4881-8a1e-a6c57249df12 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.295431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1c368-a93a-4881-8a1e-a6c57249df12 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.295903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b383d1-aaea-4522-aca3-0caf9aaf6b7f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.300680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483247bd-ccca-4691-9003-928122f3e510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.302051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483247bd-ccca-4691-9003-928122f3e510 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.302330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040c1e6-18c9-45f2-a306-c402970ff68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.302584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483247bd-ccca-4691-9003-928122f3e510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.303034 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040c1e6-18c9-45f2-a306-c402970ff68e admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.303136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483247bd-ccca-4691-9003-928122f3e510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.303356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040c1e6-18c9-45f2-a306-c402970ff68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.303643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040c1e6-18c9-45f2-a306-c402970ff68e admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.303757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483247bd-ccca-4691-9003-928122f3e510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.304376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040c1e6-18c9-45f2-a306-c402970ff68e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.305642 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483247bd-ccca-4691-9003-928122f3e510 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.306362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040c1e6-18c9-45f2-a306-c402970ff68e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.328809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1063/2147] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:36 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:36.329627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040c1e6-18c9-45f2-a306-c402970ff68e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.342933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1085/2148] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:36 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:36.342933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483247bd-ccca-4691-9003-928122f3e510 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.347748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040c1e6-18c9-45f2-a306-c402970ff68e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.406703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483247bd-ccca-4691-9003-928122f3e510 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.408584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d9b79-3ac3-4725-8cfd-e84208084d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.409483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9b79-3ac3-4725-8cfd-e84208084d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.409766 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9b79-3ac3-4725-8cfd-e84208084d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.410043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d9b79-3ac3-4725-8cfd-e84208084d41 admin admin] PATH_INFO: `/v3/projects/47397cfc0b884acb9b4b537dc10bbb1b/users/9445f593d81640c7ad7fa24adb0234af/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.412755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d9b79-3ac3-4725-8cfd-e84208084d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47397cfc0b884acb9b4b537dc10bbb1b, user_id=9445f593d81640c7ad7fa24adb0234af, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.412874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44322eaf-5ff8-42c3-a68a-cdc0f6ab8962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.413457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322eaf-5ff8-42c3-a68a-cdc0f6ab8962 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.413749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322eaf-5ff8-42c3-a68a-cdc0f6ab8962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.414132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44322eaf-5ff8-42c3-a68a-cdc0f6ab8962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.414809 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44322eaf-5ff8-42c3-a68a-cdc0f6ab8962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.415458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d9b79-3ac3-4725-8cfd-e84208084d41 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.416581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44322eaf-5ff8-42c3-a68a-cdc0f6ab8962 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.426245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1064/2149] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:36 2022] PUT /identity/v3/projects/47397cfc0b884acb9b4b537dc10bbb1b/users/9445f593d81640c7ad7fa24adb0234af/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:36.437085 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1086/2150] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:36.437918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d9b79-3ac3-4725-8cfd-e84208084d41 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.438027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44322eaf-5ff8-42c3-a68a-cdc0f6ab8962 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.475669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:36.487971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44322eaf-5ff8-42c3-a68a-cdc0f6ab8962 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.498393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d9b79-3ac3-4725-8cfd-e84208084d41 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.503553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e243-abfa-431d-ac08-18c59772fed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.504217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e243-abfa-431d-ac08-18c59772fed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.504534 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e243-abfa-431d-ac08-18c59772fed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.504820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09e243-abfa-431d-ac08-18c59772fed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.505555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09e243-abfa-431d-ac08-18c59772fed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.507481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09e243-abfa-431d-ac08-18c59772fed6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.517563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1065/2151] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:36.518391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e243-abfa-431d-ac08-18c59772fed6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.525831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:36.529215 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09e243-abfa-431d-ac08-18c59772fed6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.534107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a433bd-742f-40b0-9f41-ce2fc3a3b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.535536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a433bd-742f-40b0-9f41-ce2fc3a3b5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.536470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a433bd-742f-40b0-9f41-ce2fc3a3b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.536779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a433bd-742f-40b0-9f41-ce2fc3a3b5f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.537480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a433bd-742f-40b0-9f41-ce2fc3a3b5f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.539430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a433bd-742f-40b0-9f41-ce2fc3a3b5f8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.544263 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e0e8f-3938-4d43-93db-683465ce746b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.545153 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0e8f-3938-4d43-93db-683465ce746b service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.545443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0e8f-3938-4d43-93db-683465ce746b service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.545723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0e8f-3938-4d43-93db-683465ce746b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.547683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ee8e0e8f-3938-4d43-93db-683465ce746b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:36.566107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1066/2152] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:36 2022] POST /identity/v3/users => generated 285 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:36.566107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac3c6-2c37-4110-879d-6615a65f9d64 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.566107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac3c6-2c37-4110-879d-6615a65f9d64 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.566107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac3c6-2c37-4110-879d-6615a65f9d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.593935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6b0ac3c6-2c37-4110-879d-6615a65f9d64 None None] MFA Rules not processed for user `9445f593d81640c7ad7fa24adb0234af`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:36.595182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6b0ac3c6-2c37-4110-879d-6615a65f9d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:36.616334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e0e8f-3938-4d43-93db-683465ce746b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.617828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e0e8f-3938-4d43-93db-683465ce746b service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.627481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1087/2153] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:36.628357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e0e8f-3938-4d43-93db-683465ce746b service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.641291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e0e8f-3938-4d43-93db-683465ce746b service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.647000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8f466-43f5-41ec-af20-5f979f8c8e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.647478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8f466-43f5-41ec-af20-5f979f8c8e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.647778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8f466-43f5-41ec-af20-5f979f8c8e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.648066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8f466-43f5-41ec-af20-5f979f8c8e7a admin admin] PATH_INFO: `/v3/projects/8fcaa1b071e24f9e988e1fab67b94b70/users/df3b1b33e8094ead8b9634106a4b9c35/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.665545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8f466-43f5-41ec-af20-5f979f8c8e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcaa1b071e24f9e988e1fab67b94b70, user_id=df3b1b33e8094ead8b9634106a4b9c35, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.668262 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8f466-43f5-41ec-af20-5f979f8c8e7a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.674880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1067/2154] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:36.675738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac3c6-2c37-4110-879d-6615a65f9d64 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.690579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1088/2155] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:36 2022] PUT /identity/v3/projects/8fcaa1b071e24f9e988e1fab67b94b70/users/df3b1b33e8094ead8b9634106a4b9c35/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:36.691444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8f466-43f5-41ec-af20-5f979f8c8e7a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.691559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac3c6-2c37-4110-879d-6615a65f9d64 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.768656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5ecbb-3cdc-418a-8a64-806aca5f9ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.769500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5ecbb-3cdc-418a-8a64-806aca5f9ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.769850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5ecbb-3cdc-418a-8a64-806aca5f9ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.770279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5ecbb-3cdc-418a-8a64-806aca5f9ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.771267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5ecbb-3cdc-418a-8a64-806aca5f9ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.771681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8f466-43f5-41ec-af20-5f979f8c8e7a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.773289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5ecbb-3cdc-418a-8a64-806aca5f9ce7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.776815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ceff9-6041-462a-822c-a48256e74a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.777521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ceff9-6041-462a-822c-a48256e74a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.777816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ceff9-6041-462a-822c-a48256e74a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.778097 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ceff9-6041-462a-822c-a48256e74a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.778885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ceff9-6041-462a-822c-a48256e74a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.780486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ceff9-6041-462a-822c-a48256e74a8f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.789119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1068/2156] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:36.790121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5ecbb-3cdc-418a-8a64-806aca5f9ce7 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.791899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c6c5ecbb-3cdc-418a-8a64-806aca5f9ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:36.795927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1089/2157] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:36.797402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced91c60-62ae-446c-8c09-fee47480690a None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.797865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced91c60-62ae-446c-8c09-fee47480690a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.798312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced91c60-62ae-446c-8c09-fee47480690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.832770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ced91c60-62ae-446c-8c09-fee47480690a None None] MFA Rules not processed for user `df3b1b33e8094ead8b9634106a4b9c35`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:36.834134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ced91c60-62ae-446c-8c09-fee47480690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:36.844743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:36.861558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5ecbb-3cdc-418a-8a64-806aca5f9ce7 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.867537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017bf63-03bc-454c-881a-21d0dc5ebd18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:36.868076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017bf63-03bc-454c-881a-21d0dc5ebd18 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:36.868737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017bf63-03bc-454c-881a-21d0dc5ebd18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:36.869093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017bf63-03bc-454c-881a-21d0dc5ebd18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:36.939120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:36.976761 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1090/2158] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:36.976961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017bf63-03bc-454c-881a-21d0dc5ebd18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:36.977601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced91c60-62ae-446c-8c09-fee47480690a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:36.979235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017bf63-03bc-454c-881a-21d0dc5ebd18 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:36.996478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1069/2159] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:36.997390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced91c60-62ae-446c-8c09-fee47480690a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:36.997961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017bf63-03bc-454c-881a-21d0dc5ebd18 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:37.012279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017bf63-03bc-454c-881a-21d0dc5ebd18 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:37.012665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe508824-19bd-4007-bd8a-a8dbe744990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:37.013587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe508824-19bd-4007-bd8a-a8dbe744990f admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.013877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe508824-19bd-4007-bd8a-a8dbe744990f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.014174 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe508824-19bd-4007-bd8a-a8dbe744990f admin admin] PATH_INFO: `/v3/projects/bc773c1e59304cf58c89bfd6707b7ec0/users/e7bd87bcd9b148d899ceb09f9f311ad0/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.018751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da93ba-cc95-4c77-bdda-99fad04e02fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:37.019657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da93ba-cc95-4c77-bdda-99fad04e02fc admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.020301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da93ba-cc95-4c77-bdda-99fad04e02fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.020678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da93ba-cc95-4c77-bdda-99fad04e02fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.021727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da93ba-cc95-4c77-bdda-99fad04e02fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:37.023714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da93ba-cc95-4c77-bdda-99fad04e02fc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:37.041616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1070/2160] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:37.045619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da93ba-cc95-4c77-bdda-99fad04e02fc admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:37.058906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da93ba-cc95-4c77-bdda-99fad04e02fc admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:37.062376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe508824-19bd-4007-bd8a-a8dbe744990f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc773c1e59304cf58c89bfd6707b7ec0, user_id=e7bd87bcd9b148d899ceb09f9f311ad0, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:37.065033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe508824-19bd-4007-bd8a-a8dbe744990f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:37.070564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3a671-b841-4c5c-8309-8971cfa08e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:37.072080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a671-b841-4c5c-8309-8971cfa08e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.072528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a671-b841-4c5c-8309-8971cfa08e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.072939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a671-b841-4c5c-8309-8971cfa08e56 admin admin] PATH_INFO: `/v3/projects/f15a48d2b05842809e50e75c9f5bfcb5/users/2a84dc47627443108da7210e51a8dcff/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.095302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3a671-b841-4c5c-8309-8971cfa08e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15a48d2b05842809e50e75c9f5bfcb5, user_id=2a84dc47627443108da7210e51a8dcff, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:37.099322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3a671-b841-4c5c-8309-8971cfa08e56 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:37.104197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1091/2161] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:36 2022] PUT /identity/v3/projects/bc773c1e59304cf58c89bfd6707b7ec0/users/e7bd87bcd9b148d899ceb09f9f311ad0/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:37.110227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe508824-19bd-4007-bd8a-a8dbe744990f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:37.126821 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1071/2162] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:37 2022] PUT /identity/v3/projects/f15a48d2b05842809e50e75c9f5bfcb5/users/2a84dc47627443108da7210e51a8dcff/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:37.139620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5578-a25a-48d8-8d8a-4acecd6824dc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.139918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5578-a25a-48d8-8d8a-4acecd6824dc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.140205 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5578-a25a-48d8-8d8a-4acecd6824dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.198443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-edfc5578-a25a-48d8-8d8a-4acecd6824dc None None] MFA Rules not processed for user `e7bd87bcd9b148d899ceb09f9f311ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:37.199681 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-edfc5578-a25a-48d8-8d8a-4acecd6824dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:37.214943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe508824-19bd-4007-bd8a-a8dbe744990f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:37.289045 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0640c-fae2-4b67-9c49-171404ddc6dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:37.290003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0640c-fae2-4b67-9c49-171404ddc6dd service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.290422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0640c-fae2-4b67-9c49-171404ddc6dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.290899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f0640c-fae2-4b67-9c49-171404ddc6dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.291885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1072/2163] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:37.293124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1d1a0-5c3c-4be5-a8e3-afb5233b250d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.293421 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1d1a0-5c3c-4be5-a8e3-afb5233b250d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.293705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1d1a0-5c3c-4be5-a8e3-afb5233b250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.324077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e9f1d1a0-5c3c-4be5-a8e3-afb5233b250d None None] MFA Rules not processed for user `2a84dc47627443108da7210e51a8dcff`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:37.325580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e9f1d1a0-5c3c-4be5-a8e3-afb5233b250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:37.366983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:37.369061 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0640c-fae2-4b67-9c49-171404ddc6dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:37.370850 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f0640c-fae2-4b67-9c49-171404ddc6dd service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:37.382471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1092/2164] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:37.405179 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0640c-fae2-4b67-9c49-171404ddc6dd service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:37.414836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f0640c-fae2-4b67-9c49-171404ddc6dd service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:37.418715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e305-6e7e-424c-a6d1-b5d5f78521f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:37.419378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e305-6e7e-424c-a6d1-b5d5f78521f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.419671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e305-6e7e-424c-a6d1-b5d5f78521f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.419953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451e305-6e7e-424c-a6d1-b5d5f78521f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.431738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1073/2165] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:37.431738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1d1a0-5c3c-4be5-a8e3-afb5233b250d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:37.432452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451e305-6e7e-424c-a6d1-b5d5f78521f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:37.432738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451e305-6e7e-424c-a6d1-b5d5f78521f7 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:37.444722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1093/2166] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:14:37.450519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e305-6e7e-424c-a6d1-b5d5f78521f7 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:37.453168 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2451e305-6e7e-424c-a6d1-b5d5f78521f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:37.491693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:37.558759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451e305-6e7e-424c-a6d1-b5d5f78521f7 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:37.560746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1d1a0-5c3c-4be5-a8e3-afb5233b250d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:37.564750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99f889-7340-41b9-9e14-d94fb4822253 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '690a93a4d6ed4666a607b05a8c2b6549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:37.565639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99f889-7340-41b9-9e14-d94fb4822253 service glance] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.566360 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99f889-7340-41b9-9e14-d94fb4822253 service glance] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.566776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99f889-7340-41b9-9e14-d94fb4822253 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.568069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd6c2b-a506-4bf5-a24f-88c65f1db222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:37.569579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6c2b-a506-4bf5-a24f-88c65f1db222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.569858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6c2b-a506-4bf5-a24f-88c65f1db222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.570291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd6c2b-a506-4bf5-a24f-88c65f1db222 admin admin] PATH_INFO: `/v3/users/df3b1b33e8094ead8b9634106a4b9c35` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.571397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd6c2b-a506-4bf5-a24f-88c65f1db222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3b1b33e8094ead8b9634106a4b9c35)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:37.573339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd6c2b-a506-4bf5-a24f-88c65f1db222 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:37.577117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99f889-7340-41b9-9e14-d94fb4822253 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:37.578807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99f889-7340-41b9-9e14-d94fb4822253 service glance] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:37.589357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1094/2167] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:37.590880 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99f889-7340-41b9-9e14-d94fb4822253 service glance] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:37.641734 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-05bd6c2b-a506-4bf5-a24f-88c65f1db222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3b1b33e8094ead8b9634106a4b9c35'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:37.642503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-05bd6c2b-a506-4bf5-a24f-88c65f1db222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3b1b33e8094ead8b9634106a4b9c35'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:37.643209 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-05bd6c2b-a506-4bf5-a24f-88c65f1db222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3b1b33e8094ead8b9634106a4b9c35'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:37.656461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-05bd6c2b-a506-4bf5-a24f-88c65f1db222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3b1b33e8094ead8b9634106a4b9c35'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:37.673993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-05bd6c2b-a506-4bf5-a24f-88c65f1db222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3b1b33e8094ead8b9634106a4b9c35'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:37.694891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99f889-7340-41b9-9e14-d94fb4822253 service glance] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:37.702276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d55c9-4147-4438-8ff0-bc3e80c7ccb7 tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9445f593d81640c7ad7fa24adb0234af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47397cfc0b884acb9b4b537dc10bbb1b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:37.703548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d55c9-4147-4438-8ff0-bc3e80c7ccb7 tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.704157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d55c9-4147-4438-8ff0-bc3e80c7ccb7 tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.705122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d55c9-4147-4438-8ff0-bc3e80c7ccb7 tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.705252 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1074/2168] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:37 2022] DELETE /identity/v3/users/df3b1b33e8094ead8b9634106a4b9c35 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:37.706304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d55c9-4147-4438-8ff0-bc3e80c7ccb7 tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:37.706814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d55c9-4147-4438-8ff0-bc3e80c7ccb7 tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:37.709772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d55c9-4147-4438-8ff0-bc3e80c7ccb7 tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:37.714906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d713-7901-4de5-80a7-105f836cb848 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.715391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d713-7901-4de5-80a7-105f836cb848 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.715827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d713-7901-4de5-80a7-105f836cb848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.724696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1095/2169] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:37.728856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d55c9-4147-4438-8ff0-bc3e80c7ccb7 tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:37.730736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e72d55c9-4147-4438-8ff0-bc3e80c7ccb7 tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:37.740613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3879d713-7901-4de5-80a7-105f836cb848 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:37.742584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3879d713-7901-4de5-80a7-105f836cb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:37.745233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d55c9-4147-4438-8ff0-bc3e80c7ccb7 tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:37.821793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:37.837872 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4617b-5221-4c86-b555-cd13679fd18b tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9445f593d81640c7ad7fa24adb0234af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47397cfc0b884acb9b4b537dc10bbb1b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:37.838691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4617b-5221-4c86-b555-cd13679fd18b tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.839006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4617b-5221-4c86-b555-cd13679fd18b tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.839292 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4617b-5221-4c86-b555-cd13679fd18b tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.840006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4617b-5221-4c86-b555-cd13679fd18b tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:37.841431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1075/2170] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:14:37.842093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b4617b-5221-4c86-b555-cd13679fd18b tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:37.852299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879d713-7901-4de5-80a7-105f836cb848 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:37.855047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3879d713-7901-4de5-80a7-105f836cb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:37.878089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1096/2171] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:37 2022] POST /identity/v3/projects => generated 353 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:37.884100 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4617b-5221-4c86-b555-cd13679fd18b tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:37.930120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:37.947361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879d713-7901-4de5-80a7-105f836cb848 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:37.967139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4617b-5221-4c86-b555-cd13679fd18b tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:37.972023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454e7b3-3d70-4f50-bb54-dbe776dd50ac tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9445f593d81640c7ad7fa24adb0234af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47397cfc0b884acb9b4b537dc10bbb1b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:37.972803 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e7b3-3d70-4f50-bb54-dbe776dd50ac tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:37.973127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e7b3-3d70-4f50-bb54-dbe776dd50ac tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:37.973414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454e7b3-3d70-4f50-bb54-dbe776dd50ac tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:37.974204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454e7b3-3d70-4f50-bb54-dbe776dd50ac tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:37.974512 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454e7b3-3d70-4f50-bb54-dbe776dd50ac tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:37.976295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454e7b3-3d70-4f50-bb54-dbe776dd50ac tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:37.989405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1097/2172] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:38.008336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf004b32-900e-4f63-8d39-64762bbe09c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:38.009008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf004b32-900e-4f63-8d39-64762bbe09c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:38.009292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf004b32-900e-4f63-8d39-64762bbe09c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:38.009579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf004b32-900e-4f63-8d39-64762bbe09c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:38.061487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454e7b3-3d70-4f50-bb54-dbe776dd50ac tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:38.075869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454e7b3-3d70-4f50-bb54-dbe776dd50ac tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:38.093547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9445f593d81640c7ad7fa24adb0234af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '47397cfc0b884acb9b4b537dc10bbb1b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:38.094471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:38.095091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:38.095396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] PATH_INFO: `/v3/projects/54071797602e42568f0e6159be97367d` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:38.097618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: Authorizing `identity:delete_project(project_id=54071797602e42568f0e6159be97367d)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:38.105855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:38.151318 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf004b32-900e-4f63-8d39-64762bbe09c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:38.153207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf004b32-900e-4f63-8d39-64762bbe09c8 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:38.166964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1076/2173] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:38.177802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54071797602e42568f0e6159be97367d', 'request_id': 'req-54c12d94-78ce-43aa-aa40-10ac6a36978a'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:38.185784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54071797602e42568f0e6159be97367d', 'request_id': 'req-54c12d94-78ce-43aa-aa40-10ac6a36978a'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:38.193772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54071797602e42568f0e6159be97367d', 'request_id': 'req-54c12d94-78ce-43aa-aa40-10ac6a36978a'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:38.224931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] The token cache is being invalidate because project 54071797602e42568f0e6159be97367d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:38.225266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:38.227340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:38.233345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1098/2174] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:38 2022] DELETE /identity/v3/projects/54071797602e42568f0e6159be97367d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:38.702600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf004b32-900e-4f63-8d39-64762bbe09c8 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:38.704567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cf004b32-900e-4f63-8d39-64762bbe09c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:38.715158 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:38.716681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:38.764077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf004b32-900e-4f63-8d39-64762bbe09c8 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:38.863696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c12d94-78ce-43aa-aa40-10ac6a36978a tempest-VolumeQuotaClassesTest-1423126450 tempest-VolumeQuotaClassesTest-1423126450-project-admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:38.870267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:38.871216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:38.871509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9b614-2349-42af-8fd5-aebb6be54ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:38.871653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:38.872004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] PATH_INFO: `/v3/projects/8fcaa1b071e24f9e988e1fab67b94b70` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:38.873312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fcaa1b071e24f9e988e1fab67b94b70)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:38.873817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9b614-2349-42af-8fd5-aebb6be54ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:38.874430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9b614-2349-42af-8fd5-aebb6be54ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:38.875071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9b614-2349-42af-8fd5-aebb6be54ce8 admin admin] PATH_INFO: `/v3/users/d0038605677f4fb4a9a92ecdf14bf483` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:38.875328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:38.884191 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9b614-2349-42af-8fd5-aebb6be54ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0038605677f4fb4a9a92ecdf14bf483)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:38.888475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9b614-2349-42af-8fd5-aebb6be54ce8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:38.897339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:38.987520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-95e9b614-2349-42af-8fd5-aebb6be54ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0038605677f4fb4a9a92ecdf14bf483'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:38.989405 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-95e9b614-2349-42af-8fd5-aebb6be54ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0038605677f4fb4a9a92ecdf14bf483'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:38.991244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-95e9b614-2349-42af-8fd5-aebb6be54ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0038605677f4fb4a9a92ecdf14bf483'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:39.011143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:39.013261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fcaa1b071e24f9e988e1fab67b94b70', 'request_id': 'req-441f73eb-6773-4159-a63c-2dc51ac111a2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:39.021798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-95e9b614-2349-42af-8fd5-aebb6be54ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0038605677f4fb4a9a92ecdf14bf483'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:39.024870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fcaa1b071e24f9e988e1fab67b94b70', 'request_id': 'req-441f73eb-6773-4159-a63c-2dc51ac111a2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:39.034735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fcaa1b071e24f9e988e1fab67b94b70', 'request_id': 'req-441f73eb-6773-4159-a63c-2dc51ac111a2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:39.049918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-95e9b614-2349-42af-8fd5-aebb6be54ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0038605677f4fb4a9a92ecdf14bf483'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:39.063773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] The token cache is being invalidate because project 8fcaa1b071e24f9e988e1fab67b94b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:39.064239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:39.065340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-441f73eb-6773-4159-a63c-2dc51ac111a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:39.069041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1099/2175] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:38 2022] DELETE /identity/v3/projects/8fcaa1b071e24f9e988e1fab67b94b70 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:39.070660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda869b9-587e-4d4b-bf22-8576ed68ff0b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.071150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda869b9-587e-4d4b-bf22-8576ed68ff0b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.071441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda869b9-587e-4d4b-bf22-8576ed68ff0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.073334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1077/2176] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:38 2022] DELETE /identity/v3/users/d0038605677f4fb4a9a92ecdf14bf483 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:39.077989 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15774516-ec35-4b5f-ad82-a17c89364cc9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.078474 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15774516-ec35-4b5f-ad82-a17c89364cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.078770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15774516-ec35-4b5f-ad82-a17c89364cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.099549 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-bda869b9-587e-4d4b-bf22-8576ed68ff0b None None] MFA Rules not processed for user `e7bd87bcd9b148d899ceb09f9f311ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:39.101132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-bda869b9-587e-4d4b-bf22-8576ed68ff0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:39.103085 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-15774516-ec35-4b5f-ad82-a17c89364cc9 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:39.104378 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-15774516-ec35-4b5f-ad82-a17c89364cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:39.182303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1100/2177] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:39.182303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bcca-e0c4-4690-9a61-434c8c08e7c2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.182303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bcca-e0c4-4690-9a61-434c8c08e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.182303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bcca-e0c4-4690-9a61-434c8c08e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.183686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1078/2178] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:39.191540 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a3253-9a73-4383-a06f-a85b71eb270b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.192539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a3253-9a73-4383-a06f-a85b71eb270b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.193098 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a3253-9a73-4383-a06f-a85b71eb270b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.216233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-9f96bcca-e0c4-4690-9a61-434c8c08e7c2 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:39.217581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9f96bcca-e0c4-4690-9a61-434c8c08e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:39.221894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-1c8a3253-9a73-4383-a06f-a85b71eb270b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:39.224297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1c8a3253-9a73-4383-a06f-a85b71eb270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:39.230521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1101/2179] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:39.237573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1079/2180] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:39.238904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bcca-e0c4-4690-9a61-434c8c08e7c2 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:39.242978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a3253-9a73-4383-a06f-a85b71eb270b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:39.244952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1c8a3253-9a73-4383-a06f-a85b71eb270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:39.250384 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bcca-e0c4-4690-9a61-434c8c08e7c2 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:39.256837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775e183-27a1-4fd6-8229-f651be39645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:39.257667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775e183-27a1-4fd6-8229-f651be39645a admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.258329 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775e183-27a1-4fd6-8229-f651be39645a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.258682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775e183-27a1-4fd6-8229-f651be39645a admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.259812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775e183-27a1-4fd6-8229-f651be39645a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:39.260623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775e183-27a1-4fd6-8229-f651be39645a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:39.263933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775e183-27a1-4fd6-8229-f651be39645a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:39.286256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1102/2181] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:39.287226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775e183-27a1-4fd6-8229-f651be39645a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:39.302337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775e183-27a1-4fd6-8229-f651be39645a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:39.310362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe384a6-1d2d-4e61-96bb-072bfb3e037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:39.311370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe384a6-1d2d-4e61-96bb-072bfb3e037f admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.311993 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe384a6-1d2d-4e61-96bb-072bfb3e037f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.312430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe384a6-1d2d-4e61-96bb-072bfb3e037f admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.313540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe384a6-1d2d-4e61-96bb-072bfb3e037f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:39.317038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe384a6-1d2d-4e61-96bb-072bfb3e037f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:39.321186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a3253-9a73-4383-a06f-a85b71eb270b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:39.325605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af3a10-3421-4017-9523-488192d30d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:39.326309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af3a10-3421-4017-9523-488192d30d46 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.326603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af3a10-3421-4017-9523-488192d30d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.326942 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af3a10-3421-4017-9523-488192d30d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.342456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af3a10-3421-4017-9523-488192d30d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:39.344848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af3a10-3421-4017-9523-488192d30d46 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:39.360059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1080/2182] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:39.374138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1103/2183] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:39 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:14:39.376011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af3a10-3421-4017-9523-488192d30d46 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:39.387367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af3a10-3421-4017-9523-488192d30d46 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:39.402067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:39.501394 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dde76-29d3-44bc-96c5-058cb7cc2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:39.502350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dde76-29d3-44bc-96c5-058cb7cc2282 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.502955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dde76-29d3-44bc-96c5-058cb7cc2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.503447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dde76-29d3-44bc-96c5-058cb7cc2282 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.504302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dde76-29d3-44bc-96c5-058cb7cc2282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:39.507182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dde76-29d3-44bc-96c5-058cb7cc2282 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:39.533503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1081/2184] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:39 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:39.538508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe384a6-1d2d-4e61-96bb-072bfb3e037f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:39.570353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe384a6-1d2d-4e61-96bb-072bfb3e037f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:39.575989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c210f38-626a-42d2-8ee5-d94ac2791c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:39.576186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c210f38-626a-42d2-8ee5-d94ac2791c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.576437 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c210f38-626a-42d2-8ee5-d94ac2791c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.576736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c210f38-626a-42d2-8ee5-d94ac2791c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.578112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c210f38-626a-42d2-8ee5-d94ac2791c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:39.583095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c210f38-626a-42d2-8ee5-d94ac2791c4b admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:39.596193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1104/2185] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:39.597600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dde76-29d3-44bc-96c5-058cb7cc2282 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:39.618606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dde76-29d3-44bc-96c5-058cb7cc2282 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:39.624240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb34135-48c4-4d1b-a168-6d2840efb354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:39.625115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb34135-48c4-4d1b-a168-6d2840efb354 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.625541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb34135-48c4-4d1b-a168-6d2840efb354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.625897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb34135-48c4-4d1b-a168-6d2840efb354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.628029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb34135-48c4-4d1b-a168-6d2840efb354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:39.628916 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb34135-48c4-4d1b-a168-6d2840efb354 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:39.646212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1082/2186] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:39.648835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c210f38-626a-42d2-8ee5-d94ac2791c4b admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:39.665395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c210f38-626a-42d2-8ee5-d94ac2791c4b admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:39.674833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac822a-f0f8-4355-b1e8-7ae49e88ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:39.676074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac822a-f0f8-4355-b1e8-7ae49e88ac83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.676954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac822a-f0f8-4355-b1e8-7ae49e88ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.677450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac822a-f0f8-4355-b1e8-7ae49e88ac83 admin admin] PATH_INFO: `/v3/projects/e41359e2af5a47899fb8a9ef7d7ec6b0/users/20cc47b55324424c80c7fdf3f70ce4e6/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.733514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac822a-f0f8-4355-b1e8-7ae49e88ac83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41359e2af5a47899fb8a9ef7d7ec6b0, user_id=20cc47b55324424c80c7fdf3f70ce4e6, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:39.736735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac822a-f0f8-4355-b1e8-7ae49e88ac83 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:39.774971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1105/2187] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:39 2022] PUT /identity/v3/projects/e41359e2af5a47899fb8a9ef7d7ec6b0/users/20cc47b55324424c80c7fdf3f70ce4e6/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:39.781343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c47f4-e253-4209-b155-44e99e1cbd27 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:39.781856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c47f4-e253-4209-b155-44e99e1cbd27 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:39.781940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c47f4-e253-4209-b155-44e99e1cbd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:39.822511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8b0c47f4-e253-4209-b155-44e99e1cbd27 None None] MFA Rules not processed for user `20cc47b55324424c80c7fdf3f70ce4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:39.824030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8b0c47f4-e253-4209-b155-44e99e1cbd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:39.943068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1083/2188] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:39.957515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac822a-f0f8-4355-b1e8-7ae49e88ac83 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:39.961323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7cac822a-f0f8-4355-b1e8-7ae49e88ac83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:40.076464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c47f4-e253-4209-b155-44e99e1cbd27 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:40.080302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8b0c47f4-e253-4209-b155-44e99e1cbd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:40.112679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac822a-f0f8-4355-b1e8-7ae49e88ac83 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:40.139750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b948a-e5ee-4e77-a1ab-29d00344a9b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:40.142938 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b948a-e5ee-4e77-a1ab-29d00344a9b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:40.143336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b948a-e5ee-4e77-a1ab-29d00344a9b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:40.143805 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b948a-e5ee-4e77-a1ab-29d00344a9b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:40.174215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b948a-e5ee-4e77-a1ab-29d00344a9b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:40.174215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b948a-e5ee-4e77-a1ab-29d00344a9b3 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:40.189000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1106/2189] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:40.208233 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c47f4-e253-4209-b155-44e99e1cbd27 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:40.225325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:40.226471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:40.226791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:40.227049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] PATH_INFO: `/v3/projects/ec4ffe63b69d4a2794735aa6c5acc67d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:40.228451 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec4ffe63b69d4a2794735aa6c5acc67d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:40.230451 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:40.276465 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:40.328460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec4ffe63b69d4a2794735aa6c5acc67d', 'request_id': 'req-00fed921-64b3-464e-a733-ed27f96a1ec8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:40.338479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec4ffe63b69d4a2794735aa6c5acc67d', 'request_id': 'req-00fed921-64b3-464e-a733-ed27f96a1ec8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:40.351802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec4ffe63b69d4a2794735aa6c5acc67d', 'request_id': 'req-00fed921-64b3-464e-a733-ed27f96a1ec8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:40.384226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] The token cache is being invalidate because project ec4ffe63b69d4a2794735aa6c5acc67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:40.384547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:40.385365 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:40.387831 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1084/2190] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:40 2022] DELETE /identity/v3/projects/ec4ffe63b69d4a2794735aa6c5acc67d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:40.391811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b948a-e5ee-4e77-a1ab-29d00344a9b3 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:40.411967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b948a-e5ee-4e77-a1ab-29d00344a9b3 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:40.420692 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:40.513407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5abf9-0394-475b-95ba-de75692af5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:40.514770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5abf9-0394-475b-95ba-de75692af5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:40.515353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5abf9-0394-475b-95ba-de75692af5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:40.515906 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5abf9-0394-475b-95ba-de75692af5be admin admin] PATH_INFO: `/v3/users/9445f593d81640c7ad7fa24adb0234af` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:40.517482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5abf9-0394-475b-95ba-de75692af5be admin admin] RBAC: Authorizing `identity:delete_user(user_id=9445f593d81640c7ad7fa24adb0234af)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:40.519463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5abf9-0394-475b-95ba-de75692af5be admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:40.615634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-efe5abf9-0394-475b-95ba-de75692af5be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9445f593d81640c7ad7fa24adb0234af'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:40.616385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-efe5abf9-0394-475b-95ba-de75692af5be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9445f593d81640c7ad7fa24adb0234af'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:40.618327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-efe5abf9-0394-475b-95ba-de75692af5be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9445f593d81640c7ad7fa24adb0234af'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:40.653181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-efe5abf9-0394-475b-95ba-de75692af5be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9445f593d81640c7ad7fa24adb0234af'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:40.668296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-efe5abf9-0394-475b-95ba-de75692af5be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9445f593d81640c7ad7fa24adb0234af'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:40.696419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1107/2191] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:40 2022] DELETE /identity/v3/users/9445f593d81640c7ad7fa24adb0234af => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:41.129307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:41.132417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:41.174272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed921-64b3-464e-a733-ed27f96a1ec8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:41.266437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:41.267326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:41.268080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:41.268368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] PATH_INFO: `/v3/projects/47397cfc0b884acb9b4b537dc10bbb1b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:41.269833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47397cfc0b884acb9b4b537dc10bbb1b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:41.272161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:41.347178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47397cfc0b884acb9b4b537dc10bbb1b', 'request_id': 'req-fa33441e-2ab6-4fe1-8b90-a72db47e4977'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:41.353053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47397cfc0b884acb9b4b537dc10bbb1b', 'request_id': 'req-fa33441e-2ab6-4fe1-8b90-a72db47e4977'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:41.361332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47397cfc0b884acb9b4b537dc10bbb1b', 'request_id': 'req-fa33441e-2ab6-4fe1-8b90-a72db47e4977'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:41.377480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] The token cache is being invalidate because project 47397cfc0b884acb9b4b537dc10bbb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:41.377924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:41.378901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fa33441e-2ab6-4fe1-8b90-a72db47e4977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:41.382115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1085/2192] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:41 2022] DELETE /identity/v3/projects/47397cfc0b884acb9b4b537dc10bbb1b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:41.387454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe196d-8f57-472b-aa2f-5a7451f402fb None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:41.389179 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe196d-8f57-472b-aa2f-5a7451f402fb None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:41.389547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe196d-8f57-472b-aa2f-5a7451f402fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:41.413205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-49fe196d-8f57-472b-aa2f-5a7451f402fb None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:41.414524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-49fe196d-8f57-472b-aa2f-5a7451f402fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:41.490706 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1108/2193] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:41.498703 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dea8d-c369-4992-90f8-12457d634f85 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:41.499085 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dea8d-c369-4992-90f8-12457d634f85 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:41.499503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067dea8d-c369-4992-90f8-12457d634f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:41.521378 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-067dea8d-c369-4992-90f8-12457d634f85 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:41.522334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-067dea8d-c369-4992-90f8-12457d634f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:41.530546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1086/2194] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:41.534740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe196d-8f57-472b-aa2f-5a7451f402fb None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:41.545724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe196d-8f57-472b-aa2f-5a7451f402fb None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:41.550856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80441d5-9f7a-407a-a5cb-e26c04c2d4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:41.552556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80441d5-9f7a-407a-a5cb-e26c04c2d4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:41.552848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80441d5-9f7a-407a-a5cb-e26c04c2d4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:41.553138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80441d5-9f7a-407a-a5cb-e26c04c2d4f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:41.554065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80441d5-9f7a-407a-a5cb-e26c04c2d4f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:41.554430 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80441d5-9f7a-407a-a5cb-e26c04c2d4f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:41.556118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80441d5-9f7a-407a-a5cb-e26c04c2d4f4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:41.571130 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1109/2195] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:41.576465 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dea8d-c369-4992-90f8-12457d634f85 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:41.596770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067dea8d-c369-4992-90f8-12457d634f85 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:41.602863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1c48-12b1-4ea9-974b-03da1bdab56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:41.603840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1c48-12b1-4ea9-974b-03da1bdab56d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:41.604047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1c48-12b1-4ea9-974b-03da1bdab56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:41.604391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee1c48-12b1-4ea9-974b-03da1bdab56d admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:41.605319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee1c48-12b1-4ea9-974b-03da1bdab56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:41.607674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee1c48-12b1-4ea9-974b-03da1bdab56d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:41.637083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1087/2196] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:41 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:41.641456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80441d5-9f7a-407a-a5cb-e26c04c2d4f4 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:41.653424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80441d5-9f7a-407a-a5cb-e26c04c2d4f4 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:41.666935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:41.730536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526add5-2f97-48c4-a5e9-0ab276ee5772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:41.731595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526add5-2f97-48c4-a5e9-0ab276ee5772 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:41.731595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526add5-2f97-48c4-a5e9-0ab276ee5772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:41.731858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526add5-2f97-48c4-a5e9-0ab276ee5772 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:41.732830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526add5-2f97-48c4-a5e9-0ab276ee5772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:41.735082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526add5-2f97-48c4-a5e9-0ab276ee5772 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:41.761853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1110/2197] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:41 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:41.765867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1c48-12b1-4ea9-974b-03da1bdab56d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:41.779551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee1c48-12b1-4ea9-974b-03da1bdab56d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:41.793187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509aa84-c6e2-446e-b58f-2fa10d4476f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:41.794177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509aa84-c6e2-446e-b58f-2fa10d4476f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:41.794707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509aa84-c6e2-446e-b58f-2fa10d4476f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:41.796333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509aa84-c6e2-446e-b58f-2fa10d4476f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:41.797307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509aa84-c6e2-446e-b58f-2fa10d4476f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:41.799069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509aa84-c6e2-446e-b58f-2fa10d4476f8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:41.817833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1088/2198] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:41.818727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526add5-2f97-48c4-a5e9-0ab276ee5772 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:41.831496 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526add5-2f97-48c4-a5e9-0ab276ee5772 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:41.839555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d949ba-780f-4c21-81b3-1860c3b4d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:41.840551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d949ba-780f-4c21-81b3-1860c3b4d459 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:41.840866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d949ba-780f-4c21-81b3-1860c3b4d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:41.841124 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d949ba-780f-4c21-81b3-1860c3b4d459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:41.841941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d949ba-780f-4c21-81b3-1860c3b4d459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:41.843715 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d949ba-780f-4c21-81b3-1860c3b4d459 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:41.858223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1111/2199] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:41.860684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509aa84-c6e2-446e-b58f-2fa10d4476f8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:41.871952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:41.876432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509aa84-c6e2-446e-b58f-2fa10d4476f8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:41.885324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933523c3-2c11-4840-8cde-a6865f9fe781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:41.886731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933523c3-2c11-4840-8cde-a6865f9fe781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:41.887383 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933523c3-2c11-4840-8cde-a6865f9fe781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:41.888296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933523c3-2c11-4840-8cde-a6865f9fe781 admin admin] PATH_INFO: `/v3/projects/9508e1c6ff7d44b9af75e32e0700f3dd/users/a6cc226d037e42c09a3e3dc361aa55a4/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:41.907052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933523c3-2c11-4840-8cde-a6865f9fe781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9508e1c6ff7d44b9af75e32e0700f3dd, user_id=a6cc226d037e42c09a3e3dc361aa55a4, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:41.909837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933523c3-2c11-4840-8cde-a6865f9fe781 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:41.924992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1089/2200] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:41 2022] PUT /identity/v3/projects/9508e1c6ff7d44b9af75e32e0700f3dd/users/a6cc226d037e42c09a3e3dc361aa55a4/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:41.936796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30385d0e-01bb-4eb1-9093-63af1d4bfbb2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:41.937088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30385d0e-01bb-4eb1-9093-63af1d4bfbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:41.937388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30385d0e-01bb-4eb1-9093-63af1d4bfbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:41.976144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-30385d0e-01bb-4eb1-9093-63af1d4bfbb2 None None] MFA Rules not processed for user `a6cc226d037e42c09a3e3dc361aa55a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:41.979639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-30385d0e-01bb-4eb1-9093-63af1d4bfbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:42.086656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1112/2201] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:42.098863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933523c3-2c11-4840-8cde-a6865f9fe781 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:42.100903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-933523c3-2c11-4840-8cde-a6865f9fe781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:42.168520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933523c3-2c11-4840-8cde-a6865f9fe781 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:42.174185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdb343-feb0-4e52-83a8-f60c6ec58711 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '690a93a4d6ed4666a607b05a8c2b6549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:42.174185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb343-feb0-4e52-83a8-f60c6ec58711 service glance] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:42.174185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb343-feb0-4e52-83a8-f60c6ec58711 service glance] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:42.174185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb343-feb0-4e52-83a8-f60c6ec58711 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:42.185736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdb343-feb0-4e52-83a8-f60c6ec58711 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:42.186991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdb343-feb0-4e52-83a8-f60c6ec58711 service glance] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:42.197177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1090/2202] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:42.580942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30385d0e-01bb-4eb1-9093-63af1d4bfbb2 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:42.584065 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-30385d0e-01bb-4eb1-9093-63af1d4bfbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:42.705731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30385d0e-01bb-4eb1-9093-63af1d4bfbb2 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:42.715735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:42.716798 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:42.717338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:42.717991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] PATH_INFO: `/v3/users/758049eae6b343689ae5f3621ae137d1` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:42.721333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] RBAC: Authorizing `identity:delete_user(user_id=758049eae6b343689ae5f3621ae137d1)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:42.726288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:42.779621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:42.847397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758049eae6b343689ae5f3621ae137d1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:42.849901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758049eae6b343689ae5f3621ae137d1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:42.850475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758049eae6b343689ae5f3621ae137d1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:42.869337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758049eae6b343689ae5f3621ae137d1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:42.881192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758049eae6b343689ae5f3621ae137d1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:42.923974 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1113/2203] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:42 2022] DELETE /identity/v3/users/758049eae6b343689ae5f3621ae137d1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:42.931168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a644a-d024-4040-841e-008b323454a8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:42.931458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a644a-d024-4040-841e-008b323454a8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:42.931736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a644a-d024-4040-841e-008b323454a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:42.956653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ad1a644a-d024-4040-841e-008b323454a8 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:42.958337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ad1a644a-d024-4040-841e-008b323454a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:43.034269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1091/2204] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:43.044465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:43.045978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:43.123016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de605123-28b8-4991-89b1-c5ba4264717f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:43.126920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea823c-35d7-4663-951a-3b10337b36f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:43.127676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea823c-35d7-4663-951a-3b10337b36f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:43.128033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea823c-35d7-4663-951a-3b10337b36f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:43.128385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea823c-35d7-4663-951a-3b10337b36f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:43.138971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea823c-35d7-4663-951a-3b10337b36f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:43.140498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea823c-35d7-4663-951a-3b10337b36f5 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:43.150796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1114/2205] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:43.432044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a644a-d024-4040-841e-008b323454a8 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:43.434073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ad1a644a-d024-4040-841e-008b323454a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:43.448240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a644a-d024-4040-841e-008b323454a8 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:43.454092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:43.455193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:43.455616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:43.456024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] PATH_INFO: `/v3/projects/6038257a00c649f2a65f55abb71a166b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:43.458482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6038257a00c649f2a65f55abb71a166b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:43.461205 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:43.514271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6038257a00c649f2a65f55abb71a166b', 'request_id': 'req-29550ba3-4495-4882-a79b-3629d313d034'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:43.520580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6038257a00c649f2a65f55abb71a166b', 'request_id': 'req-29550ba3-4495-4882-a79b-3629d313d034'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:43.530319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6038257a00c649f2a65f55abb71a166b', 'request_id': 'req-29550ba3-4495-4882-a79b-3629d313d034'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:43.543081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] The token cache is being invalidate because project 6038257a00c649f2a65f55abb71a166b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:43.543407 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:43.544010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:43.548319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1092/2206] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:43 2022] DELETE /identity/v3/projects/6038257a00c649f2a65f55abb71a166b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:43.549927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea823c-35d7-4663-951a-3b10337b36f5 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:43.560165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea823c-35d7-4663-951a-3b10337b36f5 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:43.628323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463cb7a1-675f-4f9f-b5ba-8f7826a17081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:43.629366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cb7a1-675f-4f9f-b5ba-8f7826a17081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:43.629629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cb7a1-675f-4f9f-b5ba-8f7826a17081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:43.629861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463cb7a1-675f-4f9f-b5ba-8f7826a17081 admin admin] PATH_INFO: `/v3/users/cd8eeb9232c347c2a24fd3d1229eaefb` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:43.631604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463cb7a1-675f-4f9f-b5ba-8f7826a17081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8eeb9232c347c2a24fd3d1229eaefb)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:43.633808 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463cb7a1-675f-4f9f-b5ba-8f7826a17081 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:43.695770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:43.701841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-463cb7a1-675f-4f9f-b5ba-8f7826a17081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8eeb9232c347c2a24fd3d1229eaefb'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:43.703519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-463cb7a1-675f-4f9f-b5ba-8f7826a17081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8eeb9232c347c2a24fd3d1229eaefb'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:43.705446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-463cb7a1-675f-4f9f-b5ba-8f7826a17081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8eeb9232c347c2a24fd3d1229eaefb'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:43.717859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-463cb7a1-675f-4f9f-b5ba-8f7826a17081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8eeb9232c347c2a24fd3d1229eaefb'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:43.738522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-463cb7a1-675f-4f9f-b5ba-8f7826a17081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8eeb9232c347c2a24fd3d1229eaefb'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:43.765260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1115/2207] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:43 2022] DELETE /identity/v3/users/cd8eeb9232c347c2a24fd3d1229eaefb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:44.234298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:44.236052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:44.249151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29550ba3-4495-4882-a79b-3629d313d034 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:44.252921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:44.323890 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:44.324780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:44.325067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:44.325345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] PATH_INFO: `/v3/projects/2e7f4d0d773c4b24ad6a1873ac567167` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:44.327161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7f4d0d773c4b24ad6a1873ac567167)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:44.329152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:44.381173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7f4d0d773c4b24ad6a1873ac567167', 'request_id': 'req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:44.386567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7f4d0d773c4b24ad6a1873ac567167', 'request_id': 'req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:44.394047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7f4d0d773c4b24ad6a1873ac567167', 'request_id': 'req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:44.406126 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] The token cache is being invalidate because project 2e7f4d0d773c4b24ad6a1873ac567167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:44.406463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:44.407147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9e6e0d57-24b6-4a2e-b9da-374455f5cb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:44.408970 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1093/2208] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:44 2022] DELETE /identity/v3/projects/2e7f4d0d773c4b24ad6a1873ac567167 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:44.417269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a9540-26b1-4ae6-8f44-9e2545ece445 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:44.417571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a9540-26b1-4ae6-8f44-9e2545ece445 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:44.417859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a9540-26b1-4ae6-8f44-9e2545ece445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:44.439196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ee5a9540-26b1-4ae6-8f44-9e2545ece445 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:44.441060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ee5a9540-26b1-4ae6-8f44-9e2545ece445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:44.510718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1116/2209] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:44.518458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eb007-573b-4a97-8e58-03349bbf5acb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:44.519259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eb007-573b-4a97-8e58-03349bbf5acb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:44.519259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4eb007-573b-4a97-8e58-03349bbf5acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:44.540828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fb4eb007-573b-4a97-8e58-03349bbf5acb None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:44.542083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fb4eb007-573b-4a97-8e58-03349bbf5acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:44.550747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1094/2210] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:44.555634 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a9540-26b1-4ae6-8f44-9e2545ece445 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:44.566815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a9540-26b1-4ae6-8f44-9e2545ece445 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:44.573042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825dc64-d5eb-4fab-80b7-741f88e2ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:44.573749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825dc64-d5eb-4fab-80b7-741f88e2ce60 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:44.574098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825dc64-d5eb-4fab-80b7-741f88e2ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:44.574903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825dc64-d5eb-4fab-80b7-741f88e2ce60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:44.575186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825dc64-d5eb-4fab-80b7-741f88e2ce60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:44.575504 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825dc64-d5eb-4fab-80b7-741f88e2ce60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:44.577136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825dc64-d5eb-4fab-80b7-741f88e2ce60 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:44.590216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1117/2211] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:14:44.594872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eb007-573b-4a97-8e58-03349bbf5acb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:44.611494 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4eb007-573b-4a97-8e58-03349bbf5acb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:44.618774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae96f59-c3ba-4321-8c85-7833945057b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:44.619620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae96f59-c3ba-4321-8c85-7833945057b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:44.619926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae96f59-c3ba-4321-8c85-7833945057b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:44.620179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae96f59-c3ba-4321-8c85-7833945057b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:44.620919 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae96f59-c3ba-4321-8c85-7833945057b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:44.623116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae96f59-c3ba-4321-8c85-7833945057b1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:44.656460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1095/2212] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:44 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:14:44.661152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825dc64-d5eb-4fab-80b7-741f88e2ce60 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:44.672328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825dc64-d5eb-4fab-80b7-741f88e2ce60 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:44.747764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e4c13-7b19-4048-b285-e597844b7f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:44.748473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e4c13-7b19-4048-b285-e597844b7f8a admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:44.748768 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e4c13-7b19-4048-b285-e597844b7f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:44.749049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e4c13-7b19-4048-b285-e597844b7f8a admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:44.749772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e4c13-7b19-4048-b285-e597844b7f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:44.752200 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e4c13-7b19-4048-b285-e597844b7f8a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:44.786366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1118/2213] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:44 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:44.794357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae96f59-c3ba-4321-8c85-7833945057b1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:44.806322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae96f59-c3ba-4321-8c85-7833945057b1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:44.811410 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f20f3c-36f3-499b-b781-7de38498423a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:44.812201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f20f3c-36f3-499b-b781-7de38498423a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:44.812583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f20f3c-36f3-499b-b781-7de38498423a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:44.812938 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f20f3c-36f3-499b-b781-7de38498423a admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:44.813767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f20f3c-36f3-499b-b781-7de38498423a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:44.815558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f20f3c-36f3-499b-b781-7de38498423a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:44.830222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1096/2214] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:44.835457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e4c13-7b19-4048-b285-e597844b7f8a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:44.851449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e4c13-7b19-4048-b285-e597844b7f8a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:44.860153 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a702a93-31e2-4805-88e2-a3019b7ad0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:44.861697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702a93-31e2-4805-88e2-a3019b7ad0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:44.862218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702a93-31e2-4805-88e2-a3019b7ad0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:44.863287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a702a93-31e2-4805-88e2-a3019b7ad0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:44.864877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a702a93-31e2-4805-88e2-a3019b7ad0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:44.867619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a702a93-31e2-4805-88e2-a3019b7ad0e5 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:44.886646 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1119/2215] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:44.887471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f20f3c-36f3-499b-b781-7de38498423a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:44.908095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f20f3c-36f3-499b-b781-7de38498423a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:44.913867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e70dc-01cf-4dd4-b9b3-c3aa826974bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:44.914915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e70dc-01cf-4dd4-b9b3-c3aa826974bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:44.915280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e70dc-01cf-4dd4-b9b3-c3aa826974bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:44.915816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e70dc-01cf-4dd4-b9b3-c3aa826974bc admin admin] PATH_INFO: `/v3/projects/c14144e0676449b488c59f9e392a4eeb/users/0e6f11f0a83546b487e759665f21b452/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:44.934865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e70dc-01cf-4dd4-b9b3-c3aa826974bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c14144e0676449b488c59f9e392a4eeb, user_id=0e6f11f0a83546b487e759665f21b452, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:44.938303 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e70dc-01cf-4dd4-b9b3-c3aa826974bc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:44.976994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1097/2216] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:44 2022] PUT /identity/v3/projects/c14144e0676449b488c59f9e392a4eeb/users/0e6f11f0a83546b487e759665f21b452/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:44.992337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b2a2-cdcf-479c-bf06-61a3b9eb7b84 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:44.992630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b2a2-cdcf-479c-bf06-61a3b9eb7b84 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:44.992915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585b2a2-cdcf-479c-bf06-61a3b9eb7b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:45.032280 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f585b2a2-cdcf-479c-bf06-61a3b9eb7b84 None None] MFA Rules not processed for user `0e6f11f0a83546b487e759665f21b452`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:45.033685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f585b2a2-cdcf-479c-bf06-61a3b9eb7b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:45.055525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:45.132161 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1120/2217] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:45.152433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e70dc-01cf-4dd4-b9b3-c3aa826974bc admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:45.154731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a61e70dc-01cf-4dd4-b9b3-c3aa826974bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:45.205523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:45.244965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e70dc-01cf-4dd4-b9b3-c3aa826974bc admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:45.250713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c46e5b-68c7-4a08-bcf5-d5b5a33b9747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:45.251564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c46e5b-68c7-4a08-bcf5-d5b5a33b9747 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:45.251849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c46e5b-68c7-4a08-bcf5-d5b5a33b9747 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:45.252750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c46e5b-68c7-4a08-bcf5-d5b5a33b9747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:45.263738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c46e5b-68c7-4a08-bcf5-d5b5a33b9747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:45.265299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c46e5b-68c7-4a08-bcf5-d5b5a33b9747 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:45.298086 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1098/2218] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:47.881888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585b2a2-cdcf-479c-bf06-61a3b9eb7b84 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:47.883359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f585b2a2-cdcf-479c-bf06-61a3b9eb7b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:47.962286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585b2a2-cdcf-479c-bf06-61a3b9eb7b84 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:47.967249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9420d-fe89-437a-bd8f-c02183a72efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:47.968224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9420d-fe89-437a-bd8f-c02183a72efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:47.968577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9420d-fe89-437a-bd8f-c02183a72efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:47.968927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9420d-fe89-437a-bd8f-c02183a72efa admin admin] PATH_INFO: `/v3/users/75f62561a96f471b9dcc660e7aa9ff60` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:47.970260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9420d-fe89-437a-bd8f-c02183a72efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f62561a96f471b9dcc660e7aa9ff60)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:47.972398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9420d-fe89-437a-bd8f-c02183a72efa admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:48.024115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0bd9420d-fe89-437a-bd8f-c02183a72efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f62561a96f471b9dcc660e7aa9ff60'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:48.024777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0bd9420d-fe89-437a-bd8f-c02183a72efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f62561a96f471b9dcc660e7aa9ff60'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:48.025478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0bd9420d-fe89-437a-bd8f-c02183a72efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f62561a96f471b9dcc660e7aa9ff60'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:48.033519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0bd9420d-fe89-437a-bd8f-c02183a72efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f62561a96f471b9dcc660e7aa9ff60'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:48.042986 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0bd9420d-fe89-437a-bd8f-c02183a72efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f62561a96f471b9dcc660e7aa9ff60'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:48.061729 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1121/2219] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:47 2022] DELETE /identity/v3/users/75f62561a96f471b9dcc660e7aa9ff60 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:48.247244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c46e5b-68c7-4a08-bcf5-d5b5a33b9747 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:48.260835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c46e5b-68c7-4a08-bcf5-d5b5a33b9747 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:48.323802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:48.324779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:48.324985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:48.325255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] PATH_INFO: `/v3/projects/76680cc3cbbf45328e05bee398de20de` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:48.326490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76680cc3cbbf45328e05bee398de20de)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:48.328431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:48.377705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76680cc3cbbf45328e05bee398de20de', 'request_id': 'req-e3b249d6-615f-456f-9950-e4ff3791fe75'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:48.385670 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76680cc3cbbf45328e05bee398de20de', 'request_id': 'req-e3b249d6-615f-456f-9950-e4ff3791fe75'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:48.393002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76680cc3cbbf45328e05bee398de20de', 'request_id': 'req-e3b249d6-615f-456f-9950-e4ff3791fe75'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:48.406396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] The token cache is being invalidate because project 76680cc3cbbf45328e05bee398de20de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:48.406696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:48.407356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e3b249d6-615f-456f-9950-e4ff3791fe75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:48.408905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1099/2220] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:48 2022] DELETE /identity/v3/projects/76680cc3cbbf45328e05bee398de20de => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:48.413964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3250c-0cec-4977-a29a-3155203b545d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:48.414329 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3250c-0cec-4977-a29a-3155203b545d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:48.414623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3250c-0cec-4977-a29a-3155203b545d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:48.432509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-76e3250c-0cec-4977-a29a-3155203b545d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:48.433749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-76e3250c-0cec-4977-a29a-3155203b545d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:48.472791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:48.503446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1122/2221] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:48.512708 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140c23b-64b4-4926-acb5-938b1da88689 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:48.513139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140c23b-64b4-4926-acb5-938b1da88689 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:48.513428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140c23b-64b4-4926-acb5-938b1da88689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:48.533617 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6140c23b-64b4-4926-acb5-938b1da88689 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:48.534844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6140c23b-64b4-4926-acb5-938b1da88689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:48.548795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1100/2222] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:48.553438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3250c-0cec-4977-a29a-3155203b545d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:48.563139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3250c-0cec-4977-a29a-3155203b545d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:48.568423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea8859-010e-41fc-b04e-6c93ba71eedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:48.569095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea8859-010e-41fc-b04e-6c93ba71eedc admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:48.569382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea8859-010e-41fc-b04e-6c93ba71eedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:48.569664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea8859-010e-41fc-b04e-6c93ba71eedc admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:48.570449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea8859-010e-41fc-b04e-6c93ba71eedc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:48.570765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea8859-010e-41fc-b04e-6c93ba71eedc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:48.572373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea8859-010e-41fc-b04e-6c93ba71eedc admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:48.588513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1123/2223] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:14:48.589943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140c23b-64b4-4926-acb5-938b1da88689 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:48.600242 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140c23b-64b4-4926-acb5-938b1da88689 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:48.605711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65534fac-8534-4417-9f7c-8bbde9d76027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:48.606592 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65534fac-8534-4417-9f7c-8bbde9d76027 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:48.606892 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65534fac-8534-4417-9f7c-8bbde9d76027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:48.607307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65534fac-8534-4417-9f7c-8bbde9d76027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:48.607980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65534fac-8534-4417-9f7c-8bbde9d76027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:48.609936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65534fac-8534-4417-9f7c-8bbde9d76027 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:48.649467 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1101/2224] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:48 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:48.650669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea8859-010e-41fc-b04e-6c93ba71eedc admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:48.661732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea8859-010e-41fc-b04e-6c93ba71eedc admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:48.723746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9337e3-80c1-4a4d-8fa0-91df843ebac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:48.724445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9337e3-80c1-4a4d-8fa0-91df843ebac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:48.724738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9337e3-80c1-4a4d-8fa0-91df843ebac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:48.725021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9337e3-80c1-4a4d-8fa0-91df843ebac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:48.725733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9337e3-80c1-4a4d-8fa0-91df843ebac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:48.727731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9337e3-80c1-4a4d-8fa0-91df843ebac6 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:48.748651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1124/2225] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:48 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:14:48.752769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65534fac-8534-4417-9f7c-8bbde9d76027 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:48.764305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65534fac-8534-4417-9f7c-8bbde9d76027 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:48.768956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e63722-fe19-4bc6-964c-40a4f0cc29aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:48.769652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e63722-fe19-4bc6-964c-40a4f0cc29aa admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:48.769942 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e63722-fe19-4bc6-964c-40a4f0cc29aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:48.770256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e63722-fe19-4bc6-964c-40a4f0cc29aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:48.770989 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e63722-fe19-4bc6-964c-40a4f0cc29aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:48.772589 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e63722-fe19-4bc6-964c-40a4f0cc29aa admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:48.784286 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1102/2226] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:48.788748 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9337e3-80c1-4a4d-8fa0-91df843ebac6 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:48.798981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9337e3-80c1-4a4d-8fa0-91df843ebac6 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:48.804525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142d8f9-7f1f-4c95-bf99-4ae3dc900b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:48.805279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142d8f9-7f1f-4c95-bf99-4ae3dc900b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:48.805496 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142d8f9-7f1f-4c95-bf99-4ae3dc900b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:48.805774 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142d8f9-7f1f-4c95-bf99-4ae3dc900b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:48.806554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142d8f9-7f1f-4c95-bf99-4ae3dc900b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:48.808149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4142d8f9-7f1f-4c95-bf99-4ae3dc900b29 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:48.820125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1125/2227] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:48.824587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e63722-fe19-4bc6-964c-40a4f0cc29aa admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:48.834742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e63722-fe19-4bc6-964c-40a4f0cc29aa admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:48.839427 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fcfce-ea49-45bb-8026-de77ca6942d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:48.840368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fcfce-ea49-45bb-8026-de77ca6942d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:48.840638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fcfce-ea49-45bb-8026-de77ca6942d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:48.841032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fcfce-ea49-45bb-8026-de77ca6942d7 admin admin] PATH_INFO: `/v3/projects/7c32cc6ee63f4a01914902bbcf83f4fa/users/0dd6c9615fff4c60aca16023c14ed756/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:48.856548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fcfce-ea49-45bb-8026-de77ca6942d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c32cc6ee63f4a01914902bbcf83f4fa, user_id=0dd6c9615fff4c60aca16023c14ed756, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:48.859308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fcfce-ea49-45bb-8026-de77ca6942d7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:48.873645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1103/2228] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:48 2022] PUT /identity/v3/projects/7c32cc6ee63f4a01914902bbcf83f4fa/users/0dd6c9615fff4c60aca16023c14ed756/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:48.884844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec607678-fac1-4808-ba54-ffc85d1ac41b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:48.885351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec607678-fac1-4808-ba54-ffc85d1ac41b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:48.885555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec607678-fac1-4808-ba54-ffc85d1ac41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:48.916192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ec607678-fac1-4808-ba54-ffc85d1ac41b None None] MFA Rules not processed for user `0dd6c9615fff4c60aca16023c14ed756`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:48.917518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ec607678-fac1-4808-ba54-ffc85d1ac41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:48.996058 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1126/2229] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:49.000509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fcfce-ea49-45bb-8026-de77ca6942d7 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:49.007384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:49.077907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fcfce-ea49-45bb-8026-de77ca6942d7 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:49.083150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56633915-5f08-405f-9c5a-8a18db1ce6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:49.083909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56633915-5f08-405f-9c5a-8a18db1ce6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:49.084092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56633915-5f08-405f-9c5a-8a18db1ce6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:49.084372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56633915-5f08-405f-9c5a-8a18db1ce6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:49.085110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56633915-5f08-405f-9c5a-8a18db1ce6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:49.087152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56633915-5f08-405f-9c5a-8a18db1ce6a8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:49.114460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1104/2230] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:48 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:49.118573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec607678-fac1-4808-ba54-ffc85d1ac41b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:49.130253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec607678-fac1-4808-ba54-ffc85d1ac41b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:49.161882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:49.189324 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e587e-d12d-4484-a2e5-d10e0892b01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:49.190012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e587e-d12d-4484-a2e5-d10e0892b01c admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:49.190342 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e587e-d12d-4484-a2e5-d10e0892b01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:49.190630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e587e-d12d-4484-a2e5-d10e0892b01c admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:49.191676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e587e-d12d-4484-a2e5-d10e0892b01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:49.193829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e587e-d12d-4484-a2e5-d10e0892b01c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:49.219877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1127/2231] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:49 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:49.221067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56633915-5f08-405f-9c5a-8a18db1ce6a8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:49.236846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56633915-5f08-405f-9c5a-8a18db1ce6a8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:49.244069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bae626-d61b-4fef-a9a1-0fd00871685a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:49.244752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bae626-d61b-4fef-a9a1-0fd00871685a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:49.245038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bae626-d61b-4fef-a9a1-0fd00871685a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:49.245308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bae626-d61b-4fef-a9a1-0fd00871685a admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:49.246041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bae626-d61b-4fef-a9a1-0fd00871685a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:49.247684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bae626-d61b-4fef-a9a1-0fd00871685a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:49.260181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1105/2232] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:49.264190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e587e-d12d-4484-a2e5-d10e0892b01c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:49.275615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e587e-d12d-4484-a2e5-d10e0892b01c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:49.280950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5817ae4-c822-4d95-a8b6-88619600e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:49.281912 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5817ae4-c822-4d95-a8b6-88619600e190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:49.282241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5817ae4-c822-4d95-a8b6-88619600e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:49.282530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5817ae4-c822-4d95-a8b6-88619600e190 admin admin] PATH_INFO: `/v3/projects/a24c2fd3b79743478aba89dd28104122/users/3a879d8f2bff42c18b114274a421a9a8/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:49.301227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5817ae4-c822-4d95-a8b6-88619600e190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24c2fd3b79743478aba89dd28104122, user_id=3a879d8f2bff42c18b114274a421a9a8, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:49.304486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5817ae4-c822-4d95-a8b6-88619600e190 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:49.318898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1128/2233] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:49 2022] PUT /identity/v3/projects/a24c2fd3b79743478aba89dd28104122/users/3a879d8f2bff42c18b114274a421a9a8/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:49.322962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bae626-d61b-4fef-a9a1-0fd00871685a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:49.333733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bae626-d61b-4fef-a9a1-0fd00871685a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:49.395859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838b6b4-ad01-4848-b39d-dbb9f3fedd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:49.396546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838b6b4-ad01-4848-b39d-dbb9f3fedd69 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:49.396833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838b6b4-ad01-4848-b39d-dbb9f3fedd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:49.397112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838b6b4-ad01-4848-b39d-dbb9f3fedd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:49.397848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838b6b4-ad01-4848-b39d-dbb9f3fedd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:49.399511 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838b6b4-ad01-4848-b39d-dbb9f3fedd69 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:49.410852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1106/2234] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:49.415971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5817ae4-c822-4d95-a8b6-88619600e190 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:49.427548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5817ae4-c822-4d95-a8b6-88619600e190 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:49.432293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea084dce-ab66-4673-ae82-cdec5aee64fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:49.433192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea084dce-ab66-4673-ae82-cdec5aee64fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:49.433477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea084dce-ab66-4673-ae82-cdec5aee64fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:49.433755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea084dce-ab66-4673-ae82-cdec5aee64fc admin admin] PATH_INFO: `/v3/projects/a24c2fd3b79743478aba89dd28104122/users/3a879d8f2bff42c18b114274a421a9a8/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:49.436268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea084dce-ab66-4673-ae82-cdec5aee64fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24c2fd3b79743478aba89dd28104122, user_id=3a879d8f2bff42c18b114274a421a9a8, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:49.438986 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea084dce-ab66-4673-ae82-cdec5aee64fc admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:49.449848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1129/2235] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:49 2022] PUT /identity/v3/projects/a24c2fd3b79743478aba89dd28104122/users/3a879d8f2bff42c18b114274a421a9a8/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:49.460819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97f48a-504d-4964-a9b3-c5f731c32f68 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:49.461105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97f48a-504d-4964-a9b3-c5f731c32f68 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:49.461383 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97f48a-504d-4964-a9b3-c5f731c32f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:49.494310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7f97f48a-504d-4964-a9b3-c5f731c32f68 None None] MFA Rules not processed for user `3a879d8f2bff42c18b114274a421a9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:49.496771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7f97f48a-504d-4964-a9b3-c5f731c32f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:49.573572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:49.583788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1107/2236] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:49.595312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea084dce-ab66-4673-ae82-cdec5aee64fc admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:49.597086 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ea084dce-ab66-4673-ae82-cdec5aee64fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:49.666275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea084dce-ab66-4673-ae82-cdec5aee64fc admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:49.674890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e77ec-aa00-42e4-ba5d-28084f8c9859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:49.675573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e77ec-aa00-42e4-ba5d-28084f8c9859 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:49.675944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e77ec-aa00-42e4-ba5d-28084f8c9859 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:49.676233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e77ec-aa00-42e4-ba5d-28084f8c9859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:49.686921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e77ec-aa00-42e4-ba5d-28084f8c9859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:49.688618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e77ec-aa00-42e4-ba5d-28084f8c9859 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:49.699852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1130/2237] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:49.784375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97f48a-504d-4964-a9b3-c5f731c32f68 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:49.796579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97f48a-504d-4964-a9b3-c5f731c32f68 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:49.801375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6993e6e-f574-40dd-b350-ad5df0f4ab4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:49.801954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6993e6e-f574-40dd-b350-ad5df0f4ab4f service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:49.802277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6993e6e-f574-40dd-b350-ad5df0f4ab4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:49.802562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6993e6e-f574-40dd-b350-ad5df0f4ab4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:49.879884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6993e6e-f574-40dd-b350-ad5df0f4ab4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:49.879884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6993e6e-f574-40dd-b350-ad5df0f4ab4f service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:49.890441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1108/2238] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:53.683806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e77ec-aa00-42e4-ba5d-28084f8c9859 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:53.756408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e77ec-aa00-42e4-ba5d-28084f8c9859 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:53.761069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:53.761957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:53.762278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:53.762563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] PATH_INFO: `/v3/users/0dd6c9615fff4c60aca16023c14ed756` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:53.763775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dd6c9615fff4c60aca16023c14ed756)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:53.765714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:53.804792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:53.819879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dd6c9615fff4c60aca16023c14ed756'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:53.820552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dd6c9615fff4c60aca16023c14ed756'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:53.821154 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dd6c9615fff4c60aca16023c14ed756'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:53.828101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dd6c9615fff4c60aca16023c14ed756'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:53.835682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dd6c9615fff4c60aca16023c14ed756'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:53.854648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1131/2239] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:53 2022] DELETE /identity/v3/users/0dd6c9615fff4c60aca16023c14ed756 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:53.859392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213a175-6448-4ac4-ad44-803706972745 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:53.860131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213a175-6448-4ac4-ad44-803706972745 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:53.860131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213a175-6448-4ac4-ad44-803706972745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:53.880003 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0213a175-6448-4ac4-ad44-803706972745 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:53.881550 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0213a175-6448-4ac4-ad44-803706972745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:53.945818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1109/2240] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:53.956047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:53.958466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:54.018369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74a689-4565-4ec7-99eb-a316c8d35be7 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:54.022523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9b14a-b0e0-4987-ba1c-233b49563f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:54.023172 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9b14a-b0e0-4987-ba1c-233b49563f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:54.023459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9b14a-b0e0-4987-ba1c-233b49563f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:54.023741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9b14a-b0e0-4987-ba1c-233b49563f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:54.033083 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9b14a-b0e0-4987-ba1c-233b49563f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:54.035354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9b14a-b0e0-4987-ba1c-233b49563f68 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:54.045373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1132/2241] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:54.336678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213a175-6448-4ac4-ad44-803706972745 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:54.338538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0213a175-6448-4ac4-ad44-803706972745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:54.352342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213a175-6448-4ac4-ad44-803706972745 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:54.357158 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:54.359440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:54.359440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:54.359440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] PATH_INFO: `/v3/projects/7c32cc6ee63f4a01914902bbcf83f4fa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:54.367116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c32cc6ee63f4a01914902bbcf83f4fa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:54.369024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:54.432316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c32cc6ee63f4a01914902bbcf83f4fa', 'request_id': 'req-3ffd0cbc-7893-4f20-bdf7-a799657227ca'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:54.444858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c32cc6ee63f4a01914902bbcf83f4fa', 'request_id': 'req-3ffd0cbc-7893-4f20-bdf7-a799657227ca'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:54.455507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c32cc6ee63f4a01914902bbcf83f4fa', 'request_id': 'req-3ffd0cbc-7893-4f20-bdf7-a799657227ca'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:54.474560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] The token cache is being invalidate because project 7c32cc6ee63f4a01914902bbcf83f4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:54.475024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:54.477691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:54.482466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1110/2242] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:54 2022] DELETE /identity/v3/projects/7c32cc6ee63f4a01914902bbcf83f4fa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:54.485897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9b14a-b0e0-4987-ba1c-233b49563f68 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:54.501472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9b14a-b0e0-4987-ba1c-233b49563f68 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:54.598199 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff55bb-038d-44d2-a43a-14e19cf7a0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:54.598677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff55bb-038d-44d2-a43a-14e19cf7a0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:54.598964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff55bb-038d-44d2-a43a-14e19cf7a0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:54.599240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff55bb-038d-44d2-a43a-14e19cf7a0d4 admin admin] PATH_INFO: `/v3/users/3a879d8f2bff42c18b114274a421a9a8` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:54.600638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff55bb-038d-44d2-a43a-14e19cf7a0d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a879d8f2bff42c18b114274a421a9a8)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:54.602724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff55bb-038d-44d2-a43a-14e19cf7a0d4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:54.666275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e7ff55bb-038d-44d2-a43a-14e19cf7a0d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a879d8f2bff42c18b114274a421a9a8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:54.667029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e7ff55bb-038d-44d2-a43a-14e19cf7a0d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a879d8f2bff42c18b114274a421a9a8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:54.667777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e7ff55bb-038d-44d2-a43a-14e19cf7a0d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a879d8f2bff42c18b114274a421a9a8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:54.678364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:54.684678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e7ff55bb-038d-44d2-a43a-14e19cf7a0d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a879d8f2bff42c18b114274a421a9a8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:54.697395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e7ff55bb-038d-44d2-a43a-14e19cf7a0d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a879d8f2bff42c18b114274a421a9a8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:54.730017 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1133/2243] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:54 2022] DELETE /identity/v3/users/3a879d8f2bff42c18b114274a421a9a8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:55.228725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:55.230644 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:55.253795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd0cbc-7893-4f20-bdf7-a799657227ca admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:55.281165 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:55.339541 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:55.340549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:55.340944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:55.342064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] PATH_INFO: `/v3/projects/a24c2fd3b79743478aba89dd28104122` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:55.342984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24c2fd3b79743478aba89dd28104122)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:55.345086 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:55.399207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24c2fd3b79743478aba89dd28104122', 'request_id': 'req-8364e34c-9ca2-496f-b3c3-d2a028cc0161'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:55.405863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24c2fd3b79743478aba89dd28104122', 'request_id': 'req-8364e34c-9ca2-496f-b3c3-d2a028cc0161'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:55.416261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24c2fd3b79743478aba89dd28104122', 'request_id': 'req-8364e34c-9ca2-496f-b3c3-d2a028cc0161'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:55.428381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] The token cache is being invalidate because project a24c2fd3b79743478aba89dd28104122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:55.428762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:55.429503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8364e34c-9ca2-496f-b3c3-d2a028cc0161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:55.431170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1111/2244] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:55 2022] DELETE /identity/v3/projects/a24c2fd3b79743478aba89dd28104122 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:55.436937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac85f-2af0-47d1-8615-0a51289cd5bc None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:55.437271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac85f-2af0-47d1-8615-0a51289cd5bc None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:55.437548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ac85f-2af0-47d1-8615-0a51289cd5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:55.455622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-271ac85f-2af0-47d1-8615-0a51289cd5bc None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:55.457663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-271ac85f-2af0-47d1-8615-0a51289cd5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:55.531536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1134/2245] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:55.541737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cafd78-b95d-4186-b096-9bb412b4d96d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:55.542028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cafd78-b95d-4186-b096-9bb412b4d96d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:55.542351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cafd78-b95d-4186-b096-9bb412b4d96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:55.565250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f3cafd78-b95d-4186-b096-9bb412b4d96d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:55.572375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f3cafd78-b95d-4186-b096-9bb412b4d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:55.583200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1112/2246] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:55.587264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ac85f-2af0-47d1-8615-0a51289cd5bc None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:55.597831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ac85f-2af0-47d1-8615-0a51289cd5bc None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:55.603926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50812ea7-7d6c-4415-9da3-20ab7f89f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:55.604681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50812ea7-7d6c-4415-9da3-20ab7f89f002 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:55.604969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50812ea7-7d6c-4415-9da3-20ab7f89f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:55.605247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50812ea7-7d6c-4415-9da3-20ab7f89f002 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:55.606389 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50812ea7-7d6c-4415-9da3-20ab7f89f002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:14:55.606706 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50812ea7-7d6c-4415-9da3-20ab7f89f002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:55.610554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50812ea7-7d6c-4415-9da3-20ab7f89f002 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:55.624898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1135/2247] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:14:55.629985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cafd78-b95d-4186-b096-9bb412b4d96d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:55.640401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cafd78-b95d-4186-b096-9bb412b4d96d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:55.647245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95da361-1a61-4fe1-9f06-2d965c3e502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:55.647487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95da361-1a61-4fe1-9f06-2d965c3e502d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:55.647723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95da361-1a61-4fe1-9f06-2d965c3e502d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:55.648001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95da361-1a61-4fe1-9f06-2d965c3e502d admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:55.648751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95da361-1a61-4fe1-9f06-2d965c3e502d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:55.650719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95da361-1a61-4fe1-9f06-2d965c3e502d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:55.683695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1113/2248] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:55 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:55.684838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50812ea7-7d6c-4415-9da3-20ab7f89f002 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:55.695759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50812ea7-7d6c-4415-9da3-20ab7f89f002 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:55.763382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc8c48-f2f1-43e6-9112-1e60aef15a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:55.764188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc8c48-f2f1-43e6-9112-1e60aef15a97 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:55.764615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc8c48-f2f1-43e6-9112-1e60aef15a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:55.764911 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc8c48-f2f1-43e6-9112-1e60aef15a97 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:55.765637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc8c48-f2f1-43e6-9112-1e60aef15a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:55.767712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc8c48-f2f1-43e6-9112-1e60aef15a97 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:55.790196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1136/2249] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:55 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:14:55.793460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95da361-1a61-4fe1-9f06-2d965c3e502d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:55.804009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95da361-1a61-4fe1-9f06-2d965c3e502d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:55.808849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634edfa-031c-480b-88d8-de64b08fbdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:55.809526 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634edfa-031c-480b-88d8-de64b08fbdbc admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:55.809813 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634edfa-031c-480b-88d8-de64b08fbdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:55.810093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634edfa-031c-480b-88d8-de64b08fbdbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:55.810889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634edfa-031c-480b-88d8-de64b08fbdbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:55.812505 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634edfa-031c-480b-88d8-de64b08fbdbc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:55.824955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1114/2250] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:55.829267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc8c48-f2f1-43e6-9112-1e60aef15a97 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:55.840010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc8c48-f2f1-43e6-9112-1e60aef15a97 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:55.844858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72080d97-5adb-4fe9-b8d4-16faad6e2bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:55.845540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72080d97-5adb-4fe9-b8d4-16faad6e2bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:55.845833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72080d97-5adb-4fe9-b8d4-16faad6e2bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:55.846117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72080d97-5adb-4fe9-b8d4-16faad6e2bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:55.846897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72080d97-5adb-4fe9-b8d4-16faad6e2bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:55.848544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72080d97-5adb-4fe9-b8d4-16faad6e2bc0 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:55.858978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1137/2251] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:55.863243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634edfa-031c-480b-88d8-de64b08fbdbc admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:55.873251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634edfa-031c-480b-88d8-de64b08fbdbc admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:55.877944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca8a2f-5bbd-48ec-b9f9-6dd014aca7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:55.879691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca8a2f-5bbd-48ec-b9f9-6dd014aca7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:55.879984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca8a2f-5bbd-48ec-b9f9-6dd014aca7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:55.880245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca8a2f-5bbd-48ec-b9f9-6dd014aca7b2 admin admin] PATH_INFO: `/v3/projects/61a6f3813d3b43f5b05ab187e5c7868e/users/96f8eaa3736445e482ea5706064ec2a0/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:55.898514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca8a2f-5bbd-48ec-b9f9-6dd014aca7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a6f3813d3b43f5b05ab187e5c7868e, user_id=96f8eaa3736445e482ea5706064ec2a0, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:55.901796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca8a2f-5bbd-48ec-b9f9-6dd014aca7b2 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:55.916621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1115/2252] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:55 2022] PUT /identity/v3/projects/61a6f3813d3b43f5b05ab187e5c7868e/users/96f8eaa3736445e482ea5706064ec2a0/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:55.927472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3102a5d-6755-4fdf-b036-2a0e3ce72946 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:55.927764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3102a5d-6755-4fdf-b036-2a0e3ce72946 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:55.928049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3102a5d-6755-4fdf-b036-2a0e3ce72946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:55.955753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a3102a5d-6755-4fdf-b036-2a0e3ce72946 None None] MFA Rules not processed for user `96f8eaa3736445e482ea5706064ec2a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:55.958139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a3102a5d-6755-4fdf-b036-2a0e3ce72946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:55.982121 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:56.027170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1138/2253] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:14:56.031855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca8a2f-5bbd-48ec-b9f9-6dd014aca7b2 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:56.083487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:56.106962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca8a2f-5bbd-48ec-b9f9-6dd014aca7b2 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:56.111936 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554dbd2-653e-4083-8cc9-6681e523e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:56.113192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554dbd2-653e-4083-8cc9-6681e523e154 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:56.113845 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554dbd2-653e-4083-8cc9-6681e523e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:56.114097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554dbd2-653e-4083-8cc9-6681e523e154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:56.114915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554dbd2-653e-4083-8cc9-6681e523e154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:56.121173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554dbd2-653e-4083-8cc9-6681e523e154 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:56.156228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1116/2254] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:56 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:56.157295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3102a5d-6755-4fdf-b036-2a0e3ce72946 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:56.171601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3102a5d-6755-4fdf-b036-2a0e3ce72946 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:56.287182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a7711-f5f4-4dfe-8d0a-4100cf11aad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:56.287182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a7711-f5f4-4dfe-8d0a-4100cf11aad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:56.287182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a7711-f5f4-4dfe-8d0a-4100cf11aad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:56.287182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a7711-f5f4-4dfe-8d0a-4100cf11aad1 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:56.287923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a7711-f5f4-4dfe-8d0a-4100cf11aad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:56.290060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a7711-f5f4-4dfe-8d0a-4100cf11aad1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:56.315165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1139/2255] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:56 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:56.319259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554dbd2-653e-4083-8cc9-6681e523e154 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:56.332210 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554dbd2-653e-4083-8cc9-6681e523e154 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:56.337611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb0446-b399-473e-b013-9c172ee4d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:56.338450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0446-b399-473e-b013-9c172ee4d0bc admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:56.338981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0446-b399-473e-b013-9c172ee4d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:56.339354 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb0446-b399-473e-b013-9c172ee4d0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:56.340315 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb0446-b399-473e-b013-9c172ee4d0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:56.342325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb0446-b399-473e-b013-9c172ee4d0bc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:56.355357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1117/2256] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:56.359404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a7711-f5f4-4dfe-8d0a-4100cf11aad1 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:56.373515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a7711-f5f4-4dfe-8d0a-4100cf11aad1 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:56.381803 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8a240-ddc2-40c4-b1ea-dce1a9ec0fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:56.382534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a240-ddc2-40c4-b1ea-dce1a9ec0fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:56.382836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a240-ddc2-40c4-b1ea-dce1a9ec0fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:56.383100 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8a240-ddc2-40c4-b1ea-dce1a9ec0fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:56.383832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8a240-ddc2-40c4-b1ea-dce1a9ec0fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:56.385431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8a240-ddc2-40c4-b1ea-dce1a9ec0fd2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:56.397145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1140/2257] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:56.401613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb0446-b399-473e-b013-9c172ee4d0bc admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:56.412820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb0446-b399-473e-b013-9c172ee4d0bc admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:56.417755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c4f21-4cfb-42eb-b224-66434a11d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:56.418715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c4f21-4cfb-42eb-b224-66434a11d522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:56.418997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c4f21-4cfb-42eb-b224-66434a11d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:56.419272 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c4f21-4cfb-42eb-b224-66434a11d522 admin admin] PATH_INFO: `/v3/projects/e9ab94c2106849c7b42526cba0b1c40a/users/378a0de8df1f4a7abf30f2e8ba484355/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:56.433986 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c4f21-4cfb-42eb-b224-66434a11d522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ab94c2106849c7b42526cba0b1c40a, user_id=378a0de8df1f4a7abf30f2e8ba484355, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:56.436666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c4f21-4cfb-42eb-b224-66434a11d522 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:56.449778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1118/2258] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:56 2022] PUT /identity/v3/projects/e9ab94c2106849c7b42526cba0b1c40a/users/378a0de8df1f4a7abf30f2e8ba484355/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:56.461964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dee44c-f19e-4153-b28d-5cf3bfc5d4f1 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:56.462288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dee44c-f19e-4153-b28d-5cf3bfc5d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:56.462604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dee44c-f19e-4153-b28d-5cf3bfc5d4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:56.491533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b4dee44c-f19e-4153-b28d-5cf3bfc5d4f1 None None] MFA Rules not processed for user `378a0de8df1f4a7abf30f2e8ba484355`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:56.492780 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b4dee44c-f19e-4153-b28d-5cf3bfc5d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:56.563748 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1141/2259] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:56.569480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c4f21-4cfb-42eb-b224-66434a11d522 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:56.656199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c4f21-4cfb-42eb-b224-66434a11d522 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:56.662731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a07707-ce5f-4c63-9d3c-172bcde2c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:56.663424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a07707-ce5f-4c63-9d3c-172bcde2c299 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:56.663826 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a07707-ce5f-4c63-9d3c-172bcde2c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:56.664327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a07707-ce5f-4c63-9d3c-172bcde2c299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:56.665103 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a07707-ce5f-4c63-9d3c-172bcde2c299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:56.667679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a07707-ce5f-4c63-9d3c-172bcde2c299 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:56.717812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1119/2260] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:14:56 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:56.722628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dee44c-f19e-4153-b28d-5cf3bfc5d4f1 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:56.736888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dee44c-f19e-4153-b28d-5cf3bfc5d4f1 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:56.777795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:56.819031 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1791c90-859d-4e07-bfe9-400022d70480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:56.819963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791c90-859d-4e07-bfe9-400022d70480 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:56.820921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791c90-859d-4e07-bfe9-400022d70480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:56.822428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791c90-859d-4e07-bfe9-400022d70480 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:56.823191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1791c90-859d-4e07-bfe9-400022d70480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:56.826417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1791c90-859d-4e07-bfe9-400022d70480 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:56.858202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1142/2261] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:14:56 2022] POST /identity/v3/users => generated 300 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:14:56.860091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a07707-ce5f-4c63-9d3c-172bcde2c299 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:56.871232 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a07707-ce5f-4c63-9d3c-172bcde2c299 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:56.879292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55eea93-45a8-4710-a419-0c4bb3b931ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:56.880042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eea93-45a8-4710-a419-0c4bb3b931ee admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:56.880362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eea93-45a8-4710-a419-0c4bb3b931ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:56.880907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55eea93-45a8-4710-a419-0c4bb3b931ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:56.881773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55eea93-45a8-4710-a419-0c4bb3b931ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:56.883501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55eea93-45a8-4710-a419-0c4bb3b931ee admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:56.898204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1120/2262] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:14:56.901009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1791c90-859d-4e07-bfe9-400022d70480 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:56.912720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1791c90-859d-4e07-bfe9-400022d70480 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:56.918579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f75210-b20c-4993-b64b-29763d524044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:56.919507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f75210-b20c-4993-b64b-29763d524044 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:56.919783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f75210-b20c-4993-b64b-29763d524044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:56.920126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f75210-b20c-4993-b64b-29763d524044 admin admin] PATH_INFO: `/v3/projects/e2152b4f10df4ce6bdce33ed1804b210/users/ce964ee8e4804a46a47fef571c4bebba/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:56.936610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f75210-b20c-4993-b64b-29763d524044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2152b4f10df4ce6bdce33ed1804b210, user_id=ce964ee8e4804a46a47fef571c4bebba, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:56.939357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f75210-b20c-4993-b64b-29763d524044 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:56.954751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1143/2263] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:56 2022] PUT /identity/v3/projects/e2152b4f10df4ce6bdce33ed1804b210/users/ce964ee8e4804a46a47fef571c4bebba/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:56.959032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55eea93-45a8-4710-a419-0c4bb3b931ee admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:56.970760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55eea93-45a8-4710-a419-0c4bb3b931ee admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:57.033575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5cfe2-2796-4e3c-aece-0c1dfc86cb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:57.034297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5cfe2-2796-4e3c-aece-0c1dfc86cb72 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:57.034618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5cfe2-2796-4e3c-aece-0c1dfc86cb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:57.034902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5cfe2-2796-4e3c-aece-0c1dfc86cb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:57.035750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5cfe2-2796-4e3c-aece-0c1dfc86cb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:57.037361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5cfe2-2796-4e3c-aece-0c1dfc86cb72 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:57.051608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1121/2264] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:14:57.055163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f75210-b20c-4993-b64b-29763d524044 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:57.067355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f75210-b20c-4993-b64b-29763d524044 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:57.078534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf127f5-b2a2-43ef-b644-ad6458850183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:57.079465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf127f5-b2a2-43ef-b644-ad6458850183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:57.079753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf127f5-b2a2-43ef-b644-ad6458850183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:57.080034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf127f5-b2a2-43ef-b644-ad6458850183 admin admin] PATH_INFO: `/v3/projects/e2152b4f10df4ce6bdce33ed1804b210/users/ce964ee8e4804a46a47fef571c4bebba/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:57.083152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf127f5-b2a2-43ef-b644-ad6458850183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2152b4f10df4ce6bdce33ed1804b210, user_id=ce964ee8e4804a46a47fef571c4bebba, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:57.085848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf127f5-b2a2-43ef-b644-ad6458850183 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:57.101557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1144/2265] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:14:57 2022] PUT /identity/v3/projects/e2152b4f10df4ce6bdce33ed1804b210/users/ce964ee8e4804a46a47fef571c4bebba/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:14:57.113687 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32f563-87b5-488b-a2d4-ea56c5bcb6b3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:57.114325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32f563-87b5-488b-a2d4-ea56c5bcb6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:57.114776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32f563-87b5-488b-a2d4-ea56c5bcb6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:57.127694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:57.144743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7d32f563-87b5-488b-a2d4-ea56c5bcb6b3 None None] MFA Rules not processed for user `ce964ee8e4804a46a47fef571c4bebba`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:57.146102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7d32f563-87b5-488b-a2d4-ea56c5bcb6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:57.217404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1122/2266] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:57.228751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf127f5-b2a2-43ef-b644-ad6458850183 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:57.230573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8cf127f5-b2a2-43ef-b644-ad6458850183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:57.291139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf127f5-b2a2-43ef-b644-ad6458850183 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:57.295062 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a1610-595d-4c80-87c9-60c18e27122b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:57.295737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a1610-595d-4c80-87c9-60c18e27122b service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:57.296026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a1610-595d-4c80-87c9-60c18e27122b service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:57.296306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a1610-595d-4c80-87c9-60c18e27122b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:57.302950 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32f563-87b5-488b-a2d4-ea56c5bcb6b3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:57.304393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7d32f563-87b5-488b-a2d4-ea56c5bcb6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:57.309736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a1610-595d-4c80-87c9-60c18e27122b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:57.311223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a1610-595d-4c80-87c9-60c18e27122b service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:57.321798 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1145/2267] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:57.377506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32f563-87b5-488b-a2d4-ea56c5bcb6b3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:57.384242 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:57.385266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:57.385724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:57.386571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] PATH_INFO: `/v3/users/0e6f11f0a83546b487e759665f21b452` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:57.388326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6f11f0a83546b487e759665f21b452)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:57.390528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:57.460519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6f11f0a83546b487e759665f21b452'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:57.461222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6f11f0a83546b487e759665f21b452'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:57.462005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6f11f0a83546b487e759665f21b452'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:57.479128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6f11f0a83546b487e759665f21b452'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:57.501271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6f11f0a83546b487e759665f21b452'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:57.518334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1123/2268] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:14:57 2022] DELETE /identity/v3/users/0e6f11f0a83546b487e759665f21b452 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:14:57.523903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e54e8-3c6d-4d7a-829b-5ec351fb3d2e None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:57.524396 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e54e8-3c6d-4d7a-829b-5ec351fb3d2e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:57.524825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e54e8-3c6d-4d7a-829b-5ec351fb3d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:57.549776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ea9e54e8-3c6d-4d7a-829b-5ec351fb3d2e None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:14:57.561904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ea9e54e8-3c6d-4d7a-829b-5ec351fb3d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:57.632264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1146/2269] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:14:57.642179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:57.643737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:57.659261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:57.722863 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db7ac-ceef-4b28-bc1e-a75263b33473 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:57.727132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cda217-12f7-44d1-9076-35ad8262b394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:57.727875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda217-12f7-44d1-9076-35ad8262b394 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:57.728155 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda217-12f7-44d1-9076-35ad8262b394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:57.728439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda217-12f7-44d1-9076-35ad8262b394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:57.747565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cda217-12f7-44d1-9076-35ad8262b394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:57.750500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cda217-12f7-44d1-9076-35ad8262b394 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:57.763109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1124/2270] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:57.962588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e54e8-3c6d-4d7a-829b-5ec351fb3d2e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:57.964066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ea9e54e8-3c6d-4d7a-829b-5ec351fb3d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:57.999370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:14:58.028801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e54e8-3c6d-4d7a-829b-5ec351fb3d2e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:58.032926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245dbcd-17f2-45c9-b370-39f46af02b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:58.033617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245dbcd-17f2-45c9-b370-39f46af02b03 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:58.033993 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245dbcd-17f2-45c9-b370-39f46af02b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:58.034877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245dbcd-17f2-45c9-b370-39f46af02b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:58.037155 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a245dbcd-17f2-45c9-b370-39f46af02b03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:58.064512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cda217-12f7-44d1-9076-35ad8262b394 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:14:58.066755 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-52cda217-12f7-44d1-9076-35ad8262b394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:14:58.081145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cda217-12f7-44d1-9076-35ad8262b394 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:14:58.086447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:14:58.091238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:14:58.091575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:14:58.091817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] PATH_INFO: `/v3/projects/c14144e0676449b488c59f9e392a4eeb` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:14:58.093313 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c14144e0676449b488c59f9e392a4eeb)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:58.095204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:58.131019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245dbcd-17f2-45c9-b370-39f46af02b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:14:58.132841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245dbcd-17f2-45c9-b370-39f46af02b03 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:14:58.148021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1147/2271] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:14:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:14:58.153792 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c14144e0676449b488c59f9e392a4eeb', 'request_id': 'req-c91939f3-2361-417c-ada1-febb987730bd'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:58.160656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c14144e0676449b488c59f9e392a4eeb', 'request_id': 'req-c91939f3-2361-417c-ada1-febb987730bd'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:58.170919 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c14144e0676449b488c59f9e392a4eeb', 'request_id': 'req-c91939f3-2361-417c-ada1-febb987730bd'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:58.185350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] The token cache is being invalidate because project c14144e0676449b488c59f9e392a4eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:14:58.185653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:58.186901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:14:58.188695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1125/2272] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:14:58 2022] DELETE /identity/v3/projects/c14144e0676449b488c59f9e392a4eeb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:03.335960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245dbcd-17f2-45c9-b370-39f46af02b03 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:03.344641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245dbcd-17f2-45c9-b370-39f46af02b03 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:03.402132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394f8c4-63d9-4127-94cd-aeb22dade4f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:03.402831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394f8c4-63d9-4127-94cd-aeb22dade4f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:03.403121 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394f8c4-63d9-4127-94cd-aeb22dade4f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:03.403408 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394f8c4-63d9-4127-94cd-aeb22dade4f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:03.405323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2394f8c4-63d9-4127-94cd-aeb22dade4f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:03.471338 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394f8c4-63d9-4127-94cd-aeb22dade4f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:03.473203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394f8c4-63d9-4127-94cd-aeb22dade4f0 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:03.482954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1148/2273] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:04.981842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:04.983208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:05.057310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91939f3-2361-417c-ada1-febb987730bd admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:05.061915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:05.063188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:05.063583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:05.063866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] PATH_INFO: `/v3/users/20cc47b55324424c80c7fdf3f70ce4e6` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:05.065634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20cc47b55324424c80c7fdf3f70ce4e6)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:05.068041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:05.115525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:05.124081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20cc47b55324424c80c7fdf3f70ce4e6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:05.125042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20cc47b55324424c80c7fdf3f70ce4e6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:05.125709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20cc47b55324424c80c7fdf3f70ce4e6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:05.133306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20cc47b55324424c80c7fdf3f70ce4e6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:05.146071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20cc47b55324424c80c7fdf3f70ce4e6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:05.158737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1126/2274] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:04 2022] DELETE /identity/v3/users/20cc47b55324424c80c7fdf3f70ce4e6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:05.164098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c31fe-0e63-44b7-8fcf-1f947f1b7702 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:05.164614 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c31fe-0e63-44b7-8fcf-1f947f1b7702 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:05.164708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c31fe-0e63-44b7-8fcf-1f947f1b7702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:05.181826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-cb7c31fe-0e63-44b7-8fcf-1f947f1b7702 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:05.183137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cb7c31fe-0e63-44b7-8fcf-1f947f1b7702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:05.222293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:05.259883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1149/2275] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:05.270763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:05.272276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:05.360831 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a81c5-28f8-4b3e-b055-0983a89d9fb1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:05.366788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931c8cc-6094-47d6-ab4a-386702472712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:05.367462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931c8cc-6094-47d6-ab4a-386702472712 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:05.370048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931c8cc-6094-47d6-ab4a-386702472712 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:05.370361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931c8cc-6094-47d6-ab4a-386702472712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:05.383768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931c8cc-6094-47d6-ab4a-386702472712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:05.385614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931c8cc-6094-47d6-ab4a-386702472712 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:05.406226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1127/2276] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:05.781041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c31fe-0e63-44b7-8fcf-1f947f1b7702 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:05.782792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cb7c31fe-0e63-44b7-8fcf-1f947f1b7702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:05.797892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c31fe-0e63-44b7-8fcf-1f947f1b7702 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:05.803527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:05.804498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:05.804727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:05.805013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] PATH_INFO: `/v3/users/96f8eaa3736445e482ea5706064ec2a0` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:05.806302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f8eaa3736445e482ea5706064ec2a0)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:05.808284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:05.868510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f8eaa3736445e482ea5706064ec2a0'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:05.869206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f8eaa3736445e482ea5706064ec2a0'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:05.869845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f8eaa3736445e482ea5706064ec2a0'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:05.877579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f8eaa3736445e482ea5706064ec2a0'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:05.886167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f8eaa3736445e482ea5706064ec2a0'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:05.909945 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1150/2277] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:05 2022] DELETE /identity/v3/users/96f8eaa3736445e482ea5706064ec2a0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:05.915220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d771f1-ccbd-431c-a0e4-d1b5ff43032a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:05.915514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d771f1-ccbd-431c-a0e4-d1b5ff43032a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:05.915798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d771f1-ccbd-431c-a0e4-d1b5ff43032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:05.934462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-00d771f1-ccbd-431c-a0e4-d1b5ff43032a None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:05.935798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-00d771f1-ccbd-431c-a0e4-d1b5ff43032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:06.009800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1128/2278] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:06.020372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:06.022618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:06.097628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94644018-b3cb-4512-b129-fb0ad32a1eb2 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:06.109676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d040793-4c69-4626-92aa-365ee51e3d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:06.110488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d040793-4c69-4626-92aa-365ee51e3d0a service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:06.110839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d040793-4c69-4626-92aa-365ee51e3d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:06.111125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d040793-4c69-4626-92aa-365ee51e3d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:06.134077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d040793-4c69-4626-92aa-365ee51e3d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:06.136133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d040793-4c69-4626-92aa-365ee51e3d0a service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:06.149842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1151/2279] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:06.160802 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d771f1-ccbd-431c-a0e4-d1b5ff43032a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:06.162426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-00d771f1-ccbd-431c-a0e4-d1b5ff43032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:06.176758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d771f1-ccbd-431c-a0e4-d1b5ff43032a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:06.181434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:06.182363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:06.182730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:06.182934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] PATH_INFO: `/v3/projects/e41359e2af5a47899fb8a9ef7d7ec6b0` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:06.184337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41359e2af5a47899fb8a9ef7d7ec6b0)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:06.190141 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:06.271262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41359e2af5a47899fb8a9ef7d7ec6b0', 'request_id': 'req-108f2783-e2d5-40df-841c-732e73111cc2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.277739 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:06.283210 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41359e2af5a47899fb8a9ef7d7ec6b0', 'request_id': 'req-108f2783-e2d5-40df-841c-732e73111cc2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.298099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41359e2af5a47899fb8a9ef7d7ec6b0', 'request_id': 'req-108f2783-e2d5-40df-841c-732e73111cc2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.323784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] The token cache is being invalidate because project e41359e2af5a47899fb8a9ef7d7ec6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:06.324087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.324609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-108f2783-e2d5-40df-841c-732e73111cc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.326616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1129/2280] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:06 2022] DELETE /identity/v3/projects/e41359e2af5a47899fb8a9ef7d7ec6b0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:06.331576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea73dd0-158e-481b-8c3a-3b12d09dc101 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:06.332088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea73dd0-158e-481b-8c3a-3b12d09dc101 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:06.333078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea73dd0-158e-481b-8c3a-3b12d09dc101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:06.358991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-6ea73dd0-158e-481b-8c3a-3b12d09dc101 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:06.360249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6ea73dd0-158e-481b-8c3a-3b12d09dc101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:06.424148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:06.448851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1152/2281] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:06.450563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9571a7-ea28-4e9b-a6f2-bed63571dd7a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:06.450793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9571a7-ea28-4e9b-a6f2-bed63571dd7a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:06.451157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9571a7-ea28-4e9b-a6f2-bed63571dd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:06.501325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9b9571a7-ea28-4e9b-a6f2-bed63571dd7a None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:06.520756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9b9571a7-ea28-4e9b-a6f2-bed63571dd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:06.539358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1130/2282] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:06.544101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea73dd0-158e-481b-8c3a-3b12d09dc101 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:06.567201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea73dd0-158e-481b-8c3a-3b12d09dc101 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:06.584306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc2eea-5a9a-4081-9ccd-713cd78585fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:06.584306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2eea-5a9a-4081-9ccd-713cd78585fb admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:06.584306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2eea-5a9a-4081-9ccd-713cd78585fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:06.584306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2eea-5a9a-4081-9ccd-713cd78585fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:06.584703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc2eea-5a9a-4081-9ccd-713cd78585fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:06.584703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc2eea-5a9a-4081-9ccd-713cd78585fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:06.586239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc2eea-5a9a-4081-9ccd-713cd78585fb admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:06.615726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1153/2283] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:06.618870 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9571a7-ea28-4e9b-a6f2-bed63571dd7a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:06.621060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc2eea-5a9a-4081-9ccd-713cd78585fb admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:06.628475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7fcc2eea-5a9a-4081-9ccd-713cd78585fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:06.632509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9571a7-ea28-4e9b-a6f2-bed63571dd7a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:06.654425 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc2eea-5a9a-4081-9ccd-713cd78585fb admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:06.663155 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:06.663705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec44a-f3a8-4d1d-a037-2ea409bca973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:06.664415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec44a-f3a8-4d1d-a037-2ea409bca973 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:06.664705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec44a-f3a8-4d1d-a037-2ea409bca973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:06.664983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec44a-f3a8-4d1d-a037-2ea409bca973 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:06.665529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:06.665902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:06.666269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] PATH_INFO: `/v3/projects/61a6f3813d3b43f5b05ab187e5c7868e` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:06.667800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a6f3813d3b43f5b05ab187e5c7868e)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:06.672979 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:06.675927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec44a-f3a8-4d1d-a037-2ea409bca973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:06.679585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec44a-f3a8-4d1d-a037-2ea409bca973 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:06.739799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1131/2284] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:06 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:06.744701 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec44a-f3a8-4d1d-a037-2ea409bca973 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:06.800770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a6f3813d3b43f5b05ab187e5c7868e', 'request_id': 'req-e35854af-b2d5-49b2-a60b-7b5594a78127'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.809459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a6f3813d3b43f5b05ab187e5c7868e', 'request_id': 'req-e35854af-b2d5-49b2-a60b-7b5594a78127'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.815561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a6f3813d3b43f5b05ab187e5c7868e', 'request_id': 'req-e35854af-b2d5-49b2-a60b-7b5594a78127'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.828783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] The token cache is being invalidate because project 61a6f3813d3b43f5b05ab187e5c7868e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:06.829165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.829920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.832150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1154/2285] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:06 2022] DELETE /identity/v3/projects/61a6f3813d3b43f5b05ab187e5c7868e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:06.836279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:06.837562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:06.838906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec44a-f3a8-4d1d-a037-2ea409bca973 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:06.902552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bd10f-bf90-4edc-a291-275abbacc8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:06.903239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bd10f-bf90-4edc-a291-275abbacc8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:06.903664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bd10f-bf90-4edc-a291-275abbacc8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:06.903952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bd10f-bf90-4edc-a291-275abbacc8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:06.904663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bd10f-bf90-4edc-a291-275abbacc8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:06.906636 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bd10f-bf90-4edc-a291-275abbacc8f4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:06.913274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35854af-b2d5-49b2-a60b-7b5594a78127 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:06.918126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ba5e3-24f9-44fc-9f11-60fc4abf8bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:06.919184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ba5e3-24f9-44fc-9f11-60fc4abf8bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:06.919532 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ba5e3-24f9-44fc-9f11-60fc4abf8bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:06.919884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ba5e3-24f9-44fc-9f11-60fc4abf8bef admin admin] PATH_INFO: `/v3/users/378a0de8df1f4a7abf30f2e8ba484355` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:06.921360 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ba5e3-24f9-44fc-9f11-60fc4abf8bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=378a0de8df1f4a7abf30f2e8ba484355)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:06.927727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ba5e3-24f9-44fc-9f11-60fc4abf8bef admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:06.930489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1132/2286] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:06 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:06.935013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bd10f-bf90-4edc-a291-275abbacc8f4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:06.936999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-759bd10f-bf90-4edc-a291-275abbacc8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:06.949772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bd10f-bf90-4edc-a291-275abbacc8f4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:06.955451 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217005ca-9f6e-491d-80bf-c9d0434b74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:06.956663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217005ca-9f6e-491d-80bf-c9d0434b74c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:06.957076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217005ca-9f6e-491d-80bf-c9d0434b74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:06.957358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217005ca-9f6e-491d-80bf-c9d0434b74c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:06.958258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217005ca-9f6e-491d-80bf-c9d0434b74c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:06.959872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217005ca-9f6e-491d-80bf-c9d0434b74c1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:06.971653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1133/2287] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:06.975528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217005ca-9f6e-491d-80bf-c9d0434b74c1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:06.979693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a25ba5e3-24f9-44fc-9f11-60fc4abf8bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378a0de8df1f4a7abf30f2e8ba484355'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.980389 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a25ba5e3-24f9-44fc-9f11-60fc4abf8bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378a0de8df1f4a7abf30f2e8ba484355'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.981048 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a25ba5e3-24f9-44fc-9f11-60fc4abf8bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378a0de8df1f4a7abf30f2e8ba484355'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.985728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217005ca-9f6e-491d-80bf-c9d0434b74c1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:06.988946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a25ba5e3-24f9-44fc-9f11-60fc4abf8bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378a0de8df1f4a7abf30f2e8ba484355'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.991533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace0f70-1c26-41e4-8660-c865a12578d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:06.992255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0f70-1c26-41e4-8660-c865a12578d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:06.992718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0f70-1c26-41e4-8660-c865a12578d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:06.992944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace0f70-1c26-41e4-8660-c865a12578d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:06.993692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace0f70-1c26-41e4-8660-c865a12578d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:06.995457 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace0f70-1c26-41e4-8660-c865a12578d8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:06.996197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a25ba5e3-24f9-44fc-9f11-60fc4abf8bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378a0de8df1f4a7abf30f2e8ba484355'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:06.998249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:07.017680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1134/2288] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:07.022377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1155/2289] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:06 2022] DELETE /identity/v3/users/378a0de8df1f4a7abf30f2e8ba484355 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:07.023118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace0f70-1c26-41e4-8660-c865a12578d8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:07.024893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9ace0f70-1c26-41e4-8660-c865a12578d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:07.039529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace0f70-1c26-41e4-8660-c865a12578d8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:07.092031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:07.139011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f619e-7794-4237-bb9f-3e48b5d4dd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:07.140462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f619e-7794-4237-bb9f-3e48b5d4dd98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:07.140751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f619e-7794-4237-bb9f-3e48b5d4dd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:07.141120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f619e-7794-4237-bb9f-3e48b5d4dd98 admin admin] PATH_INFO: `/v3/projects/625f6b61aca8472abb4a1165a6a64aeb/users/5372b0d954ed4dc1a4abad6b6551a1bf/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:07.159757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f619e-7794-4237-bb9f-3e48b5d4dd98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625f6b61aca8472abb4a1165a6a64aeb, user_id=5372b0d954ed4dc1a4abad6b6551a1bf, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:07.162899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f619e-7794-4237-bb9f-3e48b5d4dd98 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:07.178819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1135/2290] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:07 2022] PUT /identity/v3/projects/625f6b61aca8472abb4a1165a6a64aeb/users/5372b0d954ed4dc1a4abad6b6551a1bf/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:07.190666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01773e77-2a62-4827-b88b-ffa49edaf727 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:07.190899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01773e77-2a62-4827-b88b-ffa49edaf727 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:07.191794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01773e77-2a62-4827-b88b-ffa49edaf727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:07.234016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-01773e77-2a62-4827-b88b-ffa49edaf727 None None] MFA Rules not processed for user `5372b0d954ed4dc1a4abad6b6551a1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:07.235331 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-01773e77-2a62-4827-b88b-ffa49edaf727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:07.307800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1156/2291] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:07.319774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f619e-7794-4237-bb9f-3e48b5d4dd98 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:07.321518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e82f619e-7794-4237-bb9f-3e48b5d4dd98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:07.356695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01773e77-2a62-4827-b88b-ffa49edaf727 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:07.358547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-01773e77-2a62-4827-b88b-ffa49edaf727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:07.404538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f619e-7794-4237-bb9f-3e48b5d4dd98 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:07.409530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6793d-3b46-43d8-99bc-e422fd4ac251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:07.410395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6793d-3b46-43d8-99bc-e422fd4ac251 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:07.410702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6793d-3b46-43d8-99bc-e422fd4ac251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:07.410998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6793d-3b46-43d8-99bc-e422fd4ac251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:07.420949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6793d-3b46-43d8-99bc-e422fd4ac251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:07.422453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6793d-3b46-43d8-99bc-e422fd4ac251 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:07.433625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1136/2292] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:07.462084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01773e77-2a62-4827-b88b-ffa49edaf727 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:07.467076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:07.468081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:07.468432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:07.468784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] PATH_INFO: `/v3/projects/e9ab94c2106849c7b42526cba0b1c40a` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:07.470230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ab94c2106849c7b42526cba0b1c40a)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:07.479853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:07.551386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ab94c2106849c7b42526cba0b1c40a', 'request_id': 'req-9c053a84-9001-4438-b7a9-5ef29c14a31b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:07.560460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ab94c2106849c7b42526cba0b1c40a', 'request_id': 'req-9c053a84-9001-4438-b7a9-5ef29c14a31b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:07.567409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ab94c2106849c7b42526cba0b1c40a', 'request_id': 'req-9c053a84-9001-4438-b7a9-5ef29c14a31b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:07.580381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] The token cache is being invalidate because project e9ab94c2106849c7b42526cba0b1c40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:07.580823 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:07.581847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:07.587458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1157/2293] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:07 2022] DELETE /identity/v3/projects/e9ab94c2106849c7b42526cba0b1c40a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:07.587708 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6793d-3b46-43d8-99bc-e422fd4ac251 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:07.599773 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6793d-3b46-43d8-99bc-e422fd4ac251 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:07.663692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed553c-079d-4440-b9eb-f8d8dbc85643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:07.664494 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed553c-079d-4440-b9eb-f8d8dbc85643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:07.664776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed553c-079d-4440-b9eb-f8d8dbc85643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:07.665635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed553c-079d-4440-b9eb-f8d8dbc85643 admin admin] PATH_INFO: `/v3/users/ce964ee8e4804a46a47fef571c4bebba` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:07.666876 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed553c-079d-4440-b9eb-f8d8dbc85643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce964ee8e4804a46a47fef571c4bebba)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:07.668820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed553c-079d-4440-b9eb-f8d8dbc85643 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:07.722715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-eaed553c-079d-4440-b9eb-f8d8dbc85643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce964ee8e4804a46a47fef571c4bebba'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:07.723483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-eaed553c-079d-4440-b9eb-f8d8dbc85643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce964ee8e4804a46a47fef571c4bebba'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:07.724118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-eaed553c-079d-4440-b9eb-f8d8dbc85643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce964ee8e4804a46a47fef571c4bebba'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:07.731746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-eaed553c-079d-4440-b9eb-f8d8dbc85643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce964ee8e4804a46a47fef571c4bebba'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:07.734626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:07.750790 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-eaed553c-079d-4440-b9eb-f8d8dbc85643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce964ee8e4804a46a47fef571c4bebba'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:07.765710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1137/2294] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:07 2022] DELETE /identity/v3/users/ce964ee8e4804a46a47fef571c4bebba => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:08.084604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:08.086366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:08.095150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:08.102758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c053a84-9001-4438-b7a9-5ef29c14a31b admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:08.167091 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:08.167917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.168207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.168490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] PATH_INFO: `/v3/projects/e2152b4f10df4ce6bdce33ed1804b210` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.169756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2152b4f10df4ce6bdce33ed1804b210)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:08.171750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:08.231149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2152b4f10df4ce6bdce33ed1804b210', 'request_id': 'req-05ec007b-571e-4459-8d08-648c487eabec'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:08.237942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2152b4f10df4ce6bdce33ed1804b210', 'request_id': 'req-05ec007b-571e-4459-8d08-648c487eabec'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:08.244146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2152b4f10df4ce6bdce33ed1804b210', 'request_id': 'req-05ec007b-571e-4459-8d08-648c487eabec'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:08.257403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] The token cache is being invalidate because project e2152b4f10df4ce6bdce33ed1804b210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:08.257696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:08.258361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-05ec007b-571e-4459-8d08-648c487eabec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:08.259998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1158/2295] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:08 2022] DELETE /identity/v3/projects/e2152b4f10df4ce6bdce33ed1804b210 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:08.267679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eebe33-4c6b-4ad9-8dcb-e5c93b2dca69 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.268971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eebe33-4c6b-4ad9-8dcb-e5c93b2dca69 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.268971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eebe33-4c6b-4ad9-8dcb-e5c93b2dca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.289099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-42eebe33-4c6b-4ad9-8dcb-e5c93b2dca69 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:08.290370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-42eebe33-4c6b-4ad9-8dcb-e5c93b2dca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:08.355395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1138/2296] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:08.363804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3382-39b8-42cc-8669-e4197c30d72b None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.364304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3382-39b8-42cc-8669-e4197c30d72b None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.364416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a3382-39b8-42cc-8669-e4197c30d72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.383611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0f0a3382-39b8-42cc-8669-e4197c30d72b None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:08.384821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0f0a3382-39b8-42cc-8669-e4197c30d72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:08.392742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1159/2297] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:08.397925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eebe33-4c6b-4ad9-8dcb-e5c93b2dca69 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:08.408074 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eebe33-4c6b-4ad9-8dcb-e5c93b2dca69 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:08.413464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295495a5-651b-4e3c-bd72-c60800ce71b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:08.414130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295495a5-651b-4e3c-bd72-c60800ce71b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.414448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295495a5-651b-4e3c-bd72-c60800ce71b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.414725 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295495a5-651b-4e3c-bd72-c60800ce71b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.415488 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295495a5-651b-4e3c-bd72-c60800ce71b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:08.415800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295495a5-651b-4e3c-bd72-c60800ce71b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:08.417473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295495a5-651b-4e3c-bd72-c60800ce71b5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:08.429605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1139/2298] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:08.434060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a3382-39b8-42cc-8669-e4197c30d72b None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:08.444401 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a3382-39b8-42cc-8669-e4197c30d72b None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:08.449707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f386b2-71f6-4ffe-a717-d6e81d8870a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:08.450520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f386b2-71f6-4ffe-a717-d6e81d8870a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.450904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f386b2-71f6-4ffe-a717-d6e81d8870a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.451297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f386b2-71f6-4ffe-a717-d6e81d8870a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.452056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f386b2-71f6-4ffe-a717-d6e81d8870a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:08.454036 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f386b2-71f6-4ffe-a717-d6e81d8870a4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:08.480755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1160/2299] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:08 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:08.485127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295495a5-651b-4e3c-bd72-c60800ce71b5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:08.496120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295495a5-651b-4e3c-bd72-c60800ce71b5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:08.564133 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afc0d5-c618-44dd-92a9-8ba34b6d36ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:08.564815 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc0d5-c618-44dd-92a9-8ba34b6d36ae admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.565822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc0d5-c618-44dd-92a9-8ba34b6d36ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.566067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc0d5-c618-44dd-92a9-8ba34b6d36ae admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.566874 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc0d5-c618-44dd-92a9-8ba34b6d36ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:08.568814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc0d5-c618-44dd-92a9-8ba34b6d36ae admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:08.598546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1140/2300] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:08 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:08.601116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f386b2-71f6-4ffe-a717-d6e81d8870a4 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:08.612742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f386b2-71f6-4ffe-a717-d6e81d8870a4 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:08.617635 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fce94-e264-46dd-87a9-4b5fc32dec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:08.618346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fce94-e264-46dd-87a9-4b5fc32dec5b admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.618636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fce94-e264-46dd-87a9-4b5fc32dec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.618913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fce94-e264-46dd-87a9-4b5fc32dec5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.619792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fce94-e264-46dd-87a9-4b5fc32dec5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:08.621375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fce94-e264-46dd-87a9-4b5fc32dec5b admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:08.635981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1161/2301] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:08.637367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afc0d5-c618-44dd-92a9-8ba34b6d36ae admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:08.651847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afc0d5-c618-44dd-92a9-8ba34b6d36ae admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:08.657521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c5643-ed0e-49f7-9475-2da466b7757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:08.658249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c5643-ed0e-49f7-9475-2da466b7757a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.658528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c5643-ed0e-49f7-9475-2da466b7757a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.658856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c5643-ed0e-49f7-9475-2da466b7757a admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.659671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c5643-ed0e-49f7-9475-2da466b7757a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:08.661309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c5643-ed0e-49f7-9475-2da466b7757a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:08.671583 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8697b7-9551-44ee-a6cb-3706ef9dc16c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.671905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8697b7-9551-44ee-a6cb-3706ef9dc16c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.672193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8697b7-9551-44ee-a6cb-3706ef9dc16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.672296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1141/2302] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:08.677015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c5643-ed0e-49f7-9475-2da466b7757a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:08.689047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c5643-ed0e-49f7-9475-2da466b7757a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:08.695269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffaeeb-5159-46cc-93fd-30106ed1d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:08.696371 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffaeeb-5159-46cc-93fd-30106ed1d718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.696491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-fc8697b7-9551-44ee-a6cb-3706ef9dc16c None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:08.696751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffaeeb-5159-46cc-93fd-30106ed1d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.697170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffaeeb-5159-46cc-93fd-30106ed1d718 admin admin] PATH_INFO: `/v3/projects/e65f78fe920c4cd8af0d9594065b15b1/users/d533fadfa59249cc8268ade8184688e8/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.697617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fc8697b7-9551-44ee-a6cb-3706ef9dc16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:08.715906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffaeeb-5159-46cc-93fd-30106ed1d718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65f78fe920c4cd8af0d9594065b15b1, user_id=d533fadfa59249cc8268ade8184688e8, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:08.718801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffaeeb-5159-46cc-93fd-30106ed1d718 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:08.733251 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1142/2303] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:08 2022] PUT /identity/v3/projects/e65f78fe920c4cd8af0d9594065b15b1/users/d533fadfa59249cc8268ade8184688e8/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:08.746053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a367f-3662-4dec-90dd-bfea9e72cee2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.746377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a367f-3662-4dec-90dd-bfea9e72cee2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.746649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a367f-3662-4dec-90dd-bfea9e72cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.750784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:08.766454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1162/2304] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:08.776216 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f73a367f-3662-4dec-90dd-bfea9e72cee2 None None] MFA Rules not processed for user `d533fadfa59249cc8268ade8184688e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:08.777485 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f73a367f-3662-4dec-90dd-bfea9e72cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:08.781720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:08.808998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8697b7-9551-44ee-a6cb-3706ef9dc16c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:08.810506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fc8697b7-9551-44ee-a6cb-3706ef9dc16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:08.862746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1143/2305] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:08.863928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a367f-3662-4dec-90dd-bfea9e72cee2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:08.898291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8697b7-9551-44ee-a6cb-3706ef9dc16c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:08.948628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a367f-3662-4dec-90dd-bfea9e72cee2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:08.953402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d373cd6-8129-44f3-83ad-bdd373a668cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:08.954078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373cd6-8129-44f3-83ad-bdd373a668cf admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.954463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373cd6-8129-44f3-83ad-bdd373a668cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.954923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373cd6-8129-44f3-83ad-bdd373a668cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.955438 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d373cd6-8129-44f3-83ad-bdd373a668cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:08.957909 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d373cd6-8129-44f3-83ad-bdd373a668cf admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:08.968304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669053a6-ebce-4ada-a9fe-939b94a3c89a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:08.969006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669053a6-ebce-4ada-a9fe-939b94a3c89a service swift] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:08.969297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669053a6-ebce-4ada-a9fe-939b94a3c89a service swift] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:08.969576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669053a6-ebce-4ada-a9fe-939b94a3c89a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:08.991972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1144/2306] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:08 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:08.996724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d373cd6-8129-44f3-83ad-bdd373a668cf admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:09.078275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669053a6-ebce-4ada-a9fe-939b94a3c89a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:09.080203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669053a6-ebce-4ada-a9fe-939b94a3c89a service swift] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:09.095584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d373cd6-8129-44f3-83ad-bdd373a668cf admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:09.100027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1163/2307] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:15:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:15:09.108231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b926d2-f2a5-49bd-a34d-53f526b4ab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:09.108929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b926d2-f2a5-49bd-a34d-53f526b4ab87 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:09.109465 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b926d2-f2a5-49bd-a34d-53f526b4ab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:09.109747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b926d2-f2a5-49bd-a34d-53f526b4ab87 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:09.110658 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b926d2-f2a5-49bd-a34d-53f526b4ab87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:09.113188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b926d2-f2a5-49bd-a34d-53f526b4ab87 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:09.158220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1145/2308] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:08 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:09.161260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669053a6-ebce-4ada-a9fe-939b94a3c89a service swift] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:09.173516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669053a6-ebce-4ada-a9fe-939b94a3c89a service swift] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:09.181183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a205a-b06c-456c-81fc-b78c87292f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:09.181948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a205a-b06c-456c-81fc-b78c87292f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:09.182321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a205a-b06c-456c-81fc-b78c87292f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:09.183177 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a205a-b06c-456c-81fc-b78c87292f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:09.183936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a205a-b06c-456c-81fc-b78c87292f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:09.185553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a205a-b06c-456c-81fc-b78c87292f4e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:09.202481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1164/2309] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:09.204720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b926d2-f2a5-49bd-a34d-53f526b4ab87 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:09.224976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b926d2-f2a5-49bd-a34d-53f526b4ab87 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:09.230192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1a0dd-f25b-45da-b57c-47dcf06ecfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:09.230915 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a0dd-f25b-45da-b57c-47dcf06ecfc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:09.231198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a0dd-f25b-45da-b57c-47dcf06ecfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:09.231480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1a0dd-f25b-45da-b57c-47dcf06ecfc4 admin admin] PATH_INFO: `/v3/projects/bf17a6afce9e48b3b4f0cd546043f2bf/users/62b6032be81749b7ab2ee91e6816533f/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:09.252777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1a0dd-f25b-45da-b57c-47dcf06ecfc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf17a6afce9e48b3b4f0cd546043f2bf, user_id=62b6032be81749b7ab2ee91e6816533f, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:09.256152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1a0dd-f25b-45da-b57c-47dcf06ecfc4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:09.259521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:09.273463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1146/2310] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:09 2022] PUT /identity/v3/projects/bf17a6afce9e48b3b4f0cd546043f2bf/users/62b6032be81749b7ab2ee91e6816533f/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:09.277546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a205a-b06c-456c-81fc-b78c87292f4e admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:09.291004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a205a-b06c-456c-81fc-b78c87292f4e admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:09.330963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:09.371047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9dafb-f9c2-48da-bd1d-de66f23f4fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:09.372095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9dafb-f9c2-48da-bd1d-de66f23f4fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:09.372451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9dafb-f9c2-48da-bd1d-de66f23f4fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:09.372836 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9dafb-f9c2-48da-bd1d-de66f23f4fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:09.373723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9dafb-f9c2-48da-bd1d-de66f23f4fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:09.375470 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9dafb-f9c2-48da-bd1d-de66f23f4fd8 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:09.386853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1165/2311] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:09.391188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1a0dd-f25b-45da-b57c-47dcf06ecfc4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:09.402067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1a0dd-f25b-45da-b57c-47dcf06ecfc4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:09.406991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8612c-840f-49c2-a77b-8c4d035072d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:09.407882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8612c-840f-49c2-a77b-8c4d035072d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:09.408164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8612c-840f-49c2-a77b-8c4d035072d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:09.408446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8612c-840f-49c2-a77b-8c4d035072d3 admin admin] PATH_INFO: `/v3/projects/bf17a6afce9e48b3b4f0cd546043f2bf/users/62b6032be81749b7ab2ee91e6816533f/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:09.413025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8612c-840f-49c2-a77b-8c4d035072d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf17a6afce9e48b3b4f0cd546043f2bf, user_id=62b6032be81749b7ab2ee91e6816533f, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:09.415914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8612c-840f-49c2-a77b-8c4d035072d3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:09.428677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1147/2312] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:09 2022] PUT /identity/v3/projects/bf17a6afce9e48b3b4f0cd546043f2bf/users/62b6032be81749b7ab2ee91e6816533f/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:09.439299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901baf-48a2-45ed-8490-fca998b873d2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:09.439662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901baf-48a2-45ed-8490-fca998b873d2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:09.440067 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39901baf-48a2-45ed-8490-fca998b873d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:09.471097 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-39901baf-48a2-45ed-8490-fca998b873d2 None None] MFA Rules not processed for user `62b6032be81749b7ab2ee91e6816533f`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:09.473432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-39901baf-48a2-45ed-8490-fca998b873d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:09.548037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1166/2313] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:09.560094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8612c-840f-49c2-a77b-8c4d035072d3 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:09.561956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e0b8612c-840f-49c2-a77b-8c4d035072d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:09.632315 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8612c-840f-49c2-a77b-8c4d035072d3 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:09.637139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd4f3c-99a3-4324-83a7-91a60b68a149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:09.638209 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd4f3c-99a3-4324-83a7-91a60b68a149 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:09.638573 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd4f3c-99a3-4324-83a7-91a60b68a149 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:09.638924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd4f3c-99a3-4324-83a7-91a60b68a149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:09.651724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd4f3c-99a3-4324-83a7-91a60b68a149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:09.653527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd4f3c-99a3-4324-83a7-91a60b68a149 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:09.665661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1148/2314] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:09.701591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43f53e-d9ac-48cb-a3da-fc8b967213ef None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:09.701893 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43f53e-d9ac-48cb-a3da-fc8b967213ef None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:09.702237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43f53e-d9ac-48cb-a3da-fc8b967213ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:09.725257 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5d43f53e-d9ac-48cb-a3da-fc8b967213ef None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:09.726404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5d43f53e-d9ac-48cb-a3da-fc8b967213ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:09.792712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1167/2315] 10.222.0.66 () {58 vars in 967 bytes} [Mon Jul 11 14:15:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:09.804939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd4f3c-99a3-4324-83a7-91a60b68a149 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:09.807499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43f53e-d9ac-48cb-a3da-fc8b967213ef None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:09.868418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:09.872679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd4f3c-99a3-4324-83a7-91a60b68a149 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:09.877886 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:09.878932 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:09.879288 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:09.879568 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] PATH_INFO: `/v3/users/d533fadfa59249cc8268ade8184688e8` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:09.881065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d533fadfa59249cc8268ade8184688e8)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:09.883079 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:09.886102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43f53e-d9ac-48cb-a3da-fc8b967213ef None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:09.892910 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a4376-32c1-4377-9d01-c876d5af99a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:09.894650 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a4376-32c1-4377-9d01-c876d5af99a7 service swift] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:09.895100 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a4376-32c1-4377-9d01-c876d5af99a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:09.895561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a4376-32c1-4377-9d01-c876d5af99a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:09.906652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a4376-32c1-4377-9d01-c876d5af99a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:09.908367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a4376-32c1-4377-9d01-c876d5af99a7 service swift] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:09.925443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1168/2316] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:15:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:15:09.934653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd533fadfa59249cc8268ade8184688e8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:09.938552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd533fadfa59249cc8268ade8184688e8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:09.939204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd533fadfa59249cc8268ade8184688e8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:09.948313 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd533fadfa59249cc8268ade8184688e8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:09.963562 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd533fadfa59249cc8268ade8184688e8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:09.978373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1149/2317] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:09 2022] DELETE /identity/v3/users/d533fadfa59249cc8268ade8184688e8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:09.982956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcdce-c53b-4038-b674-f8d76b0def48 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:09.983325 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcdce-c53b-4038-b674-f8d76b0def48 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:09.983609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fcdce-c53b-4038-b674-f8d76b0def48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:10.001474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-bb5fcdce-c53b-4038-b674-f8d76b0def48 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:10.003265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-bb5fcdce-c53b-4038-b674-f8d76b0def48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:10.071639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1169/2318] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:10.084178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:10.085872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:10.092753 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:10.139758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aeaf1-93a8-4b05-9785-09ac9bc48af0 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:10.140144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aeaf1-93a8-4b05-9785-09ac9bc48af0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:10.140477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aeaf1-93a8-4b05-9785-09ac9bc48af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:10.153897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d5cac-e67a-41ca-9b23-2032c869ff87 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:10.157667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eaa44-b35e-4184-9797-5dbe4bc1bbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:10.158350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eaa44-b35e-4184-9797-5dbe4bc1bbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:10.158669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eaa44-b35e-4184-9797-5dbe4bc1bbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:10.159061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39eaa44-b35e-4184-9797-5dbe4bc1bbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:10.159745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-867aeaf1-93a8-4b05-9785-09ac9bc48af0 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:10.160961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-867aeaf1-93a8-4b05-9785-09ac9bc48af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:10.168536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39eaa44-b35e-4184-9797-5dbe4bc1bbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:10.169969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39eaa44-b35e-4184-9797-5dbe4bc1bbf2 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:10.179595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1150/2319] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:10.180398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eaa44-b35e-4184-9797-5dbe4bc1bbf2 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:10.181671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a39eaa44-b35e-4184-9797-5dbe4bc1bbf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:10.194847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39eaa44-b35e-4184-9797-5dbe4bc1bbf2 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:10.199713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9859e78-d9ab-4d4f-b15d-9b28b3c06554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:10.200595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859e78-d9ab-4d4f-b15d-9b28b3c06554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:10.200885 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859e78-d9ab-4d4f-b15d-9b28b3c06554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:10.201166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9859e78-d9ab-4d4f-b15d-9b28b3c06554 admin admin] PATH_INFO: `/v3/users/5372b0d954ed4dc1a4abad6b6551a1bf` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:10.202468 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9859e78-d9ab-4d4f-b15d-9b28b3c06554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5372b0d954ed4dc1a4abad6b6551a1bf)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:10.204583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9859e78-d9ab-4d4f-b15d-9b28b3c06554 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:10.273048 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1170/2320] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:15:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:10.289343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867aeaf1-93a8-4b05-9785-09ac9bc48af0 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:10.290879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-867aeaf1-93a8-4b05-9785-09ac9bc48af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:10.307033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b9859e78-d9ab-4d4f-b15d-9b28b3c06554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5372b0d954ed4dc1a4abad6b6551a1bf'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:10.307859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b9859e78-d9ab-4d4f-b15d-9b28b3c06554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5372b0d954ed4dc1a4abad6b6551a1bf'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:10.309473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b9859e78-d9ab-4d4f-b15d-9b28b3c06554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5372b0d954ed4dc1a4abad6b6551a1bf'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:10.320545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b9859e78-d9ab-4d4f-b15d-9b28b3c06554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5372b0d954ed4dc1a4abad6b6551a1bf'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:10.353210 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b9859e78-d9ab-4d4f-b15d-9b28b3c06554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5372b0d954ed4dc1a4abad6b6551a1bf'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:10.375838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1151/2321] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:10 2022] DELETE /identity/v3/users/5372b0d954ed4dc1a4abad6b6551a1bf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:10.381243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6a0c9-b4b5-4b0a-82db-036ffc0c6e51 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:10.381736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6a0c9-b4b5-4b0a-82db-036ffc0c6e51 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:10.383884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6a0c9-b4b5-4b0a-82db-036ffc0c6e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:10.398317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867aeaf1-93a8-4b05-9785-09ac9bc48af0 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:10.436704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:10.437617 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d7a6a0c9-b4b5-4b0a-82db-036ffc0c6e51 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:10.438904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d7a6a0c9-b4b5-4b0a-82db-036ffc0c6e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:10.477114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61346979-faf3-4443-9b1f-25dcbf012528 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:10.477882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61346979-faf3-4443-9b1f-25dcbf012528 service swift] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:10.478424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61346979-faf3-4443-9b1f-25dcbf012528 service swift] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:10.478773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61346979-faf3-4443-9b1f-25dcbf012528 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:10.481432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-61346979-faf3-4443-9b1f-25dcbf012528 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:10.554448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1152/2322] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:10.567129 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6a0c9-b4b5-4b0a-82db-036ffc0c6e51 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:10.569208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d7a6a0c9-b4b5-4b0a-82db-036ffc0c6e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:10.573191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61346979-faf3-4443-9b1f-25dcbf012528 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:10.575997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61346979-faf3-4443-9b1f-25dcbf012528 service swift] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:10.588405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1171/2323] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:15:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:15:10.609954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:10.669632 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6a0c9-b4b5-4b0a-82db-036ffc0c6e51 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:10.677194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f01f-c5a7-4420-a5e9-19cffe680209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:10.677882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f01f-c5a7-4420-a5e9-19cffe680209 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:10.678198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f01f-c5a7-4420-a5e9-19cffe680209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:10.679249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495f01f-c5a7-4420-a5e9-19cffe680209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:10.703794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61346979-faf3-4443-9b1f-25dcbf012528 service swift] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:10.707237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-61346979-faf3-4443-9b1f-25dcbf012528 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:10.707662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495f01f-c5a7-4420-a5e9-19cffe680209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:10.709764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495f01f-c5a7-4420-a5e9-19cffe680209 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:10.736424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61346979-faf3-4443-9b1f-25dcbf012528 service swift] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:10.752190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1153/2324] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:10.759121 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:10.761206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:10.761515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:10.761848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] PATH_INFO: `/v3/projects/e65f78fe920c4cd8af0d9594065b15b1` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:10.767422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65f78fe920c4cd8af0d9594065b15b1)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:10.776703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:10.886190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65f78fe920c4cd8af0d9594065b15b1', 'request_id': 'req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:10.905963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65f78fe920c4cd8af0d9594065b15b1', 'request_id': 'req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:10.913691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65f78fe920c4cd8af0d9594065b15b1', 'request_id': 'req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:10.928689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] The token cache is being invalidate because project e65f78fe920c4cd8af0d9594065b15b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:10.929739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:10.930688 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f33c91fa-f26d-48d7-91ef-d4fd6c47dff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:10.933199 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1172/2325] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:10 2022] DELETE /identity/v3/projects/e65f78fe920c4cd8af0d9594065b15b1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:10.937469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f01f-c5a7-4420-a5e9-19cffe680209 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:10.954678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495f01f-c5a7-4420-a5e9-19cffe680209 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:11.040957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:11.042046 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.042453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.042828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] PATH_INFO: `/v3/users/62b6032be81749b7ab2ee91e6816533f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.044220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b6032be81749b7ab2ee91e6816533f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:11.046655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:11.138252 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b6032be81749b7ab2ee91e6816533f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.139184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b6032be81749b7ab2ee91e6816533f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.140209 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b6032be81749b7ab2ee91e6816533f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.147178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33612a-1af1-4814-a4d4-9a48c75074ab None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.147477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33612a-1af1-4814-a4d4-9a48c75074ab None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.147865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33612a-1af1-4814-a4d4-9a48c75074ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.152939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b6032be81749b7ab2ee91e6816533f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.171576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ca33612a-1af1-4814-a4d4-9a48c75074ab None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:11.174905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ca33612a-1af1-4814-a4d4-9a48c75074ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:11.177954 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b6032be81749b7ab2ee91e6816533f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.194197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1154/2326] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:10 2022] DELETE /identity/v3/users/62b6032be81749b7ab2ee91e6816533f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:11.253005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:11.254522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:11.274990 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1173/2327] 10.222.0.66 () {58 vars in 967 bytes} [Mon Jul 11 14:15:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:11.314136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33612a-1af1-4814-a4d4-9a48c75074ab None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:11.316468 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ca33612a-1af1-4814-a4d4-9a48c75074ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:11.324506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:11.360844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:11.394148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f66808-8999-4c9b-a74c-f5f379236d1a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:11.399677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:11.400617 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.400911 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.401198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] PATH_INFO: `/v3/projects/625f6b61aca8472abb4a1165a6a64aeb` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.402883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=625f6b61aca8472abb4a1165a6a64aeb)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:11.405877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:11.414044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33612a-1af1-4814-a4d4-9a48c75074ab None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:11.478319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625f6b61aca8472abb4a1165a6a64aeb', 'request_id': 'req-cdc3b229-4731-4de9-b46f-067f59507736'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.485243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625f6b61aca8472abb4a1165a6a64aeb', 'request_id': 'req-cdc3b229-4731-4de9-b46f-067f59507736'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.496431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625f6b61aca8472abb4a1165a6a64aeb', 'request_id': 'req-cdc3b229-4731-4de9-b46f-067f59507736'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.509301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] The token cache is being invalidate because project 625f6b61aca8472abb4a1165a6a64aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:11.509589 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.510501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cdc3b229-4731-4de9-b46f-067f59507736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.512137 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1155/2328] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:11 2022] DELETE /identity/v3/projects/625f6b61aca8472abb4a1165a6a64aeb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:11.517020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b74e-7562-4ee7-b3a7-d5aa612f0b8e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.517389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b74e-7562-4ee7-b3a7-d5aa612f0b8e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.517739 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995b74e-7562-4ee7-b3a7-d5aa612f0b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.520884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505be19-347d-451b-b0bd-48304fca76c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:11.521570 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505be19-347d-451b-b0bd-48304fca76c5 service swift] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.521949 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505be19-347d-451b-b0bd-48304fca76c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.522446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505be19-347d-451b-b0bd-48304fca76c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.524711 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8505be19-347d-451b-b0bd-48304fca76c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:11.538296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5995b74e-7562-4ee7-b3a7-d5aa612f0b8e None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:11.539655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5995b74e-7562-4ee7-b3a7-d5aa612f0b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:11.600205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505be19-347d-451b-b0bd-48304fca76c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:11.602036 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505be19-347d-451b-b0bd-48304fca76c5 service swift] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:11.611319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1174/2329] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:15:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:15:11.616334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1156/2330] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:11.626112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494a43-c5be-4821-a7e8-6d9111a5f0d1 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.626559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494a43-c5be-4821-a7e8-6d9111a5f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.626722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08494a43-c5be-4821-a7e8-6d9111a5f0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.627168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995b74e-7562-4ee7-b3a7-d5aa612f0b8e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:11.628875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5995b74e-7562-4ee7-b3a7-d5aa612f0b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:11.646969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995b74e-7562-4ee7-b3a7-d5aa612f0b8e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:11.650451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-08494a43-c5be-4821-a7e8-6d9111a5f0d1 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:11.652014 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-08494a43-c5be-4821-a7e8-6d9111a5f0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:11.655496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:11.656751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.657953 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.658259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] PATH_INFO: `/v3/projects/bf17a6afce9e48b3b4f0cd546043f2bf` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.660118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf17a6afce9e48b3b4f0cd546043f2bf)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:11.662100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:11.662826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1175/2331] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:11.667372 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08494a43-c5be-4821-a7e8-6d9111a5f0d1 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:11.678846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08494a43-c5be-4821-a7e8-6d9111a5f0d1 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:11.684793 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4faf9-35ff-474a-9365-fbc467adfb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:11.685487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4faf9-35ff-474a-9365-fbc467adfb71 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.685765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4faf9-35ff-474a-9365-fbc467adfb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.686050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4faf9-35ff-474a-9365-fbc467adfb71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.686971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4faf9-35ff-474a-9365-fbc467adfb71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:11.687333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4faf9-35ff-474a-9365-fbc467adfb71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:11.689213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4faf9-35ff-474a-9365-fbc467adfb71 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:11.702560 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1176/2332] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:11.707050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4faf9-35ff-474a-9365-fbc467adfb71 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:11.719453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4faf9-35ff-474a-9365-fbc467adfb71 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:11.726297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf17a6afce9e48b3b4f0cd546043f2bf', 'request_id': 'req-7d695f7c-9a29-495a-ba07-2b03030f74d6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.739736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf17a6afce9e48b3b4f0cd546043f2bf', 'request_id': 'req-7d695f7c-9a29-495a-ba07-2b03030f74d6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.751718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf17a6afce9e48b3b4f0cd546043f2bf', 'request_id': 'req-7d695f7c-9a29-495a-ba07-2b03030f74d6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.754800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:11.756236 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:11.769355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] The token cache is being invalidate because project bf17a6afce9e48b3b4f0cd546043f2bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:11.770090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.771206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d695f7c-9a29-495a-ba07-2b03030f74d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:11.773090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1157/2333] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:11 2022] DELETE /identity/v3/projects/bf17a6afce9e48b3b4f0cd546043f2bf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:11.777960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9560b-8a43-4df2-b8cb-88de6442d504 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.778250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9560b-8a43-4df2-b8cb-88de6442d504 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.778538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9560b-8a43-4df2-b8cb-88de6442d504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.798050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-07f9560b-8a43-4df2-b8cb-88de6442d504 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:11.800034 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-07f9560b-8a43-4df2-b8cb-88de6442d504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:11.802880 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdac29f-9291-4d36-a654-a7c3208238b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:11.803821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdac29f-9291-4d36-a654-a7c3208238b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.804013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdac29f-9291-4d36-a654-a7c3208238b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.804300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdac29f-9291-4d36-a654-a7c3208238b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.805115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdac29f-9291-4d36-a654-a7c3208238b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:11.807093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdac29f-9291-4d36-a654-a7c3208238b6 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:11.812256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1158/2334] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:11.820630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eddd45-aa09-4e15-b9d3-6901d0c82a7e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.820957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eddd45-aa09-4e15-b9d3-6901d0c82a7e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.821213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eddd45-aa09-4e15-b9d3-6901d0c82a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.841785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1177/2335] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:11 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:15:11.842869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdac29f-9291-4d36-a654-a7c3208238b6 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:11.844807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9fdac29f-9291-4d36-a654-a7c3208238b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:11.850539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-32eddd45-aa09-4e15-b9d3-6901d0c82a7e None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:11.851761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-32eddd45-aa09-4e15-b9d3-6901d0c82a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:11.940961 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1159/2336] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:11.947695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eddd45-aa09-4e15-b9d3-6901d0c82a7e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:11.959460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdac29f-9291-4d36-a654-a7c3208238b6 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:11.961471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eddd45-aa09-4e15-b9d3-6901d0c82a7e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:11.964609 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c580-58aa-4abd-937c-74cc8631346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:11.965446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c580-58aa-4abd-937c-74cc8631346d admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.965733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c580-58aa-4abd-937c-74cc8631346d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.966013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c580-58aa-4abd-937c-74cc8631346d admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.966919 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e094850-4b47-47a2-9e53-cf84b7c4bd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:11.967067 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301c580-58aa-4abd-937c-74cc8631346d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:11.967595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094850-4b47-47a2-9e53-cf84b7c4bd71 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:11.967883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094850-4b47-47a2-9e53-cf84b7c4bd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:11.968163 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094850-4b47-47a2-9e53-cf84b7c4bd71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:11.968897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e094850-4b47-47a2-9e53-cf84b7c4bd71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:11.969105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301c580-58aa-4abd-937c-74cc8631346d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:11.969220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e094850-4b47-47a2-9e53-cf84b7c4bd71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:11.970896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e094850-4b47-47a2-9e53-cf84b7c4bd71 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:11.991014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1160/2337] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:15:11.992305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e094850-4b47-47a2-9e53-cf84b7c4bd71 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.003288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1178/2338] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:11 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:15:12.003404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e094850-4b47-47a2-9e53-cf84b7c4bd71 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:12.004874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c580-58aa-4abd-937c-74cc8631346d admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.010504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f3ea2-8ed8-4705-b66f-c3d1c3611012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:12.011173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f3ea2-8ed8-4705-b66f-c3d1c3611012 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.011456 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f3ea2-8ed8-4705-b66f-c3d1c3611012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.011735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f3ea2-8ed8-4705-b66f-c3d1c3611012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.012718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f3ea2-8ed8-4705-b66f-c3d1c3611012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:12.014360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f3ea2-8ed8-4705-b66f-c3d1c3611012 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:12.016519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c580-58aa-4abd-937c-74cc8631346d admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:12.026170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92614ab-2d71-428d-a112-70c8c52cd5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:12.027010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92614ab-2d71-428d-a112-70c8c52cd5db admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.027953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92614ab-2d71-428d-a112-70c8c52cd5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.028627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92614ab-2d71-428d-a112-70c8c52cd5db admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.030275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92614ab-2d71-428d-a112-70c8c52cd5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:12.033141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92614ab-2d71-428d-a112-70c8c52cd5db admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:12.050398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1179/2339] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:12.054225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1161/2340] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:11 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:12.054564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92614ab-2d71-428d-a112-70c8c52cd5db admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.056400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f3ea2-8ed8-4705-b66f-c3d1c3611012 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.072516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92614ab-2d71-428d-a112-70c8c52cd5db admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:12.132860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f3ea2-8ed8-4705-b66f-c3d1c3611012 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:12.137842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee9dc-93c8-492c-b29e-343aeb175db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:12.137999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b798a5-dbe7-4ce6-a428-c8316678f6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:12.138831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b798a5-dbe7-4ce6-a428-c8316678f6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.139037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee9dc-93c8-492c-b29e-343aeb175db9 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.139159 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b798a5-dbe7-4ce6-a428-c8316678f6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.139388 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b798a5-dbe7-4ce6-a428-c8316678f6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.139595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee9dc-93c8-492c-b29e-343aeb175db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.141347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aee9dc-93c8-492c-b29e-343aeb175db9 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.141468 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b798a5-dbe7-4ce6-a428-c8316678f6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:12.141559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aee9dc-93c8-492c-b29e-343aeb175db9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:12.141918 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b798a5-dbe7-4ce6-a428-c8316678f6f3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:12.143612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aee9dc-93c8-492c-b29e-343aeb175db9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:12.158209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1180/2341] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:12.160774 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b798a5-dbe7-4ce6-a428-c8316678f6f3 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.167355 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1162/2342] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:12 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:15:12.171109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee9dc-93c8-492c-b29e-343aeb175db9 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.171913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b798a5-dbe7-4ce6-a428-c8316678f6f3 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:12.177511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51305a33-88d7-4bbf-a2fb-7bd90a66a22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:12.178898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51305a33-88d7-4bbf-a2fb-7bd90a66a22e admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.178898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51305a33-88d7-4bbf-a2fb-7bd90a66a22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.179133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51305a33-88d7-4bbf-a2fb-7bd90a66a22e admin admin] PATH_INFO: `/v3/projects/3550bc0808da423d99355454e7043f57/users/64f22cc3b8bb45d0bcf2c07ef9ccc057/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.184071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aee9dc-93c8-492c-b29e-343aeb175db9 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:12.190845 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95380e8-cfa9-4f9e-8e0d-af5def386212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:12.192088 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95380e8-cfa9-4f9e-8e0d-af5def386212 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.192632 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95380e8-cfa9-4f9e-8e0d-af5def386212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.193112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95380e8-cfa9-4f9e-8e0d-af5def386212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.194106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95380e8-cfa9-4f9e-8e0d-af5def386212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:12.196088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51305a33-88d7-4bbf-a2fb-7bd90a66a22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3550bc0808da423d99355454e7043f57, user_id=64f22cc3b8bb45d0bcf2c07ef9ccc057, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:12.196450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95380e8-cfa9-4f9e-8e0d-af5def386212 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:12.198844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51305a33-88d7-4bbf-a2fb-7bd90a66a22e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:12.214901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1163/2343] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:12.215565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95380e8-cfa9-4f9e-8e0d-af5def386212 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.222842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1181/2344] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:12 2022] PUT /identity/v3/projects/3550bc0808da423d99355454e7043f57/users/64f22cc3b8bb45d0bcf2c07ef9ccc057/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:12.228605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95380e8-cfa9-4f9e-8e0d-af5def386212 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:12.234661 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70c2fa-2052-4244-9021-545df846fedd None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.235002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70c2fa-2052-4244-9021-545df846fedd None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.235601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70c2fa-2052-4244-9021-545df846fedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.245481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:12.262879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:12.277826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-6e70c2fa-2052-4244-9021-545df846fedd None None] MFA Rules not processed for user `64f22cc3b8bb45d0bcf2c07ef9ccc057`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:12.279164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6e70c2fa-2052-4244-9021-545df846fedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:12.305237 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca9d98-62fe-4191-8b02-ff79d5cfa685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:12.306072 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca9d98-62fe-4191-8b02-ff79d5cfa685 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.306466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca9d98-62fe-4191-8b02-ff79d5cfa685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.306822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca9d98-62fe-4191-8b02-ff79d5cfa685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.307752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca9d98-62fe-4191-8b02-ff79d5cfa685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:12.310609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca9d98-62fe-4191-8b02-ff79d5cfa685 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:12.323454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1164/2345] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:12.328749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca9d98-62fe-4191-8b02-ff79d5cfa685 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.344025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca9d98-62fe-4191-8b02-ff79d5cfa685 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:12.349903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cdaa5-4f1d-41c2-826f-5f48b5c38389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:12.350977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cdaa5-4f1d-41c2-826f-5f48b5c38389 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.351331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cdaa5-4f1d-41c2-826f-5f48b5c38389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.351719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cdaa5-4f1d-41c2-826f-5f48b5c38389 admin admin] PATH_INFO: `/v3/projects/63547663b49a42a2a1f3cce697554de3/users/84c377d2e3fe4df8b9e55623336faa6b/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.363789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1182/2346] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:12.369375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cdaa5-4f1d-41c2-826f-5f48b5c38389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63547663b49a42a2a1f3cce697554de3, user_id=84c377d2e3fe4df8b9e55623336faa6b, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:12.371937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cdaa5-4f1d-41c2-826f-5f48b5c38389 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:12.380686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70c2fa-2052-4244-9021-545df846fedd None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.382782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6e70c2fa-2052-4244-9021-545df846fedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:12.388423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1165/2347] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:12 2022] PUT /identity/v3/projects/63547663b49a42a2a1f3cce697554de3/users/84c377d2e3fe4df8b9e55623336faa6b/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:12.399256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7387955-82ba-407a-9626-93772f556acb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.399613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7387955-82ba-407a-9626-93772f556acb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.399960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7387955-82ba-407a-9626-93772f556acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.436696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d7387955-82ba-407a-9626-93772f556acb None None] MFA Rules not processed for user `84c377d2e3fe4df8b9e55623336faa6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:12.437976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d7387955-82ba-407a-9626-93772f556acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:12.460228 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70c2fa-2052-4244-9021-545df846fedd None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:12.515649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1166/2348] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:12.533461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088ca78-7c62-4b98-a198-a63d8b75e976 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '690a93a4d6ed4666a607b05a8c2b6549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:12.534319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088ca78-7c62-4b98-a198-a63d8b75e976 service glance] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.534700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088ca78-7c62-4b98-a198-a63d8b75e976 service glance] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.534984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088ca78-7c62-4b98-a198-a63d8b75e976 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.546938 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7387955-82ba-407a-9626-93772f556acb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.550002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d7387955-82ba-407a-9626-93772f556acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:12.607837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088ca78-7c62-4b98-a198-a63d8b75e976 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:12.609490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088ca78-7c62-4b98-a198-a63d8b75e976 service glance] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:12.615659 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7387955-82ba-407a-9626-93772f556acb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:12.619625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f93d4-24f6-4169-968d-2d435edf540e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:12.620295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f93d4-24f6-4169-968d-2d435edf540e service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.620569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f93d4-24f6-4169-968d-2d435edf540e service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.620837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f93d4-24f6-4169-968d-2d435edf540e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.627163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1183/2349] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:12.633507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f93d4-24f6-4169-968d-2d435edf540e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:12.635038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f93d4-24f6-4169-968d-2d435edf540e service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:12.645371 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1167/2350] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:12.668153 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088ca78-7c62-4b98-a198-a63d8b75e976 service glance] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.673986 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:12.747480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088ca78-7c62-4b98-a198-a63d8b75e976 service glance] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:12.753816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:12.754749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.755019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.755550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] PATH_INFO: `/v3/users/84c377d2e3fe4df8b9e55623336faa6b` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.757169 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c377d2e3fe4df8b9e55623336faa6b)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:12.759461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:12.842671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c377d2e3fe4df8b9e55623336faa6b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:12.849096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c377d2e3fe4df8b9e55623336faa6b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:12.849858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c377d2e3fe4df8b9e55623336faa6b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:12.858413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c377d2e3fe4df8b9e55623336faa6b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:12.866783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c377d2e3fe4df8b9e55623336faa6b'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:12.888225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1184/2351] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:12 2022] DELETE /identity/v3/users/84c377d2e3fe4df8b9e55623336faa6b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:12.893635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a1f3-7b50-4dfd-af9b-d2ddd33bdabc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:12.893970 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a1f3-7b50-4dfd-af9b-d2ddd33bdabc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:12.894382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88a1f3-7b50-4dfd-af9b-d2ddd33bdabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:12.913350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5b88a1f3-7b50-4dfd-af9b-d2ddd33bdabc None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:12.914611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5b88a1f3-7b50-4dfd-af9b-d2ddd33bdabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:12.948599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:12.990665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1168/2352] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:12.998077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:12.999717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:13.076240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8ac0e-43d0-44e5-9040-fc020db172a5 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:13.081093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba190efe-2859-4e79-a1f0-e9fa1e872928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:13.081759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190efe-2859-4e79-a1f0-e9fa1e872928 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:13.082271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190efe-2859-4e79-a1f0-e9fa1e872928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:13.082555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba190efe-2859-4e79-a1f0-e9fa1e872928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:13.093607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba190efe-2859-4e79-a1f0-e9fa1e872928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:13.101655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba190efe-2859-4e79-a1f0-e9fa1e872928 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:13.115309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1185/2353] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:13.421253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88a1f3-7b50-4dfd-af9b-d2ddd33bdabc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:13.423210 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5b88a1f3-7b50-4dfd-af9b-d2ddd33bdabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:13.438508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88a1f3-7b50-4dfd-af9b-d2ddd33bdabc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:13.444471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:13.445704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:13.445959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:13.446184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] PATH_INFO: `/v3/projects/63547663b49a42a2a1f3cce697554de3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:13.447419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=63547663b49a42a2a1f3cce697554de3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:13.449370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:13.496858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63547663b49a42a2a1f3cce697554de3', 'request_id': 'req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:13.503522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63547663b49a42a2a1f3cce697554de3', 'request_id': 'req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:13.512297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63547663b49a42a2a1f3cce697554de3', 'request_id': 'req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:13.524364 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] The token cache is being invalidate because project 63547663b49a42a2a1f3cce697554de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:13.524648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:13.525275 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4228b5ad-e46c-465e-bb87-1a99a6c37b8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:13.526849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1169/2354] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:13 2022] DELETE /identity/v3/projects/63547663b49a42a2a1f3cce697554de3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:13.531828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2bc12-5664-4e42-88b3-ba82b1ac8b01 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:13.532285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2bc12-5664-4e42-88b3-ba82b1ac8b01 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:13.532395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2bc12-5664-4e42-88b3-ba82b1ac8b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:13.551064 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-6cc2bc12-5664-4e42-88b3-ba82b1ac8b01 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:13.552319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6cc2bc12-5664-4e42-88b3-ba82b1ac8b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:13.573184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:13.616564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1186/2355] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:13.624166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1e3c-0d8a-4e27-aa2a-703de0d8d75e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:13.624461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1e3c-0d8a-4e27-aa2a-703de0d8d75e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:13.624747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c1e3c-0d8a-4e27-aa2a-703de0d8d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:13.643938 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b04c1e3c-0d8a-4e27-aa2a-703de0d8d75e None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:13.645165 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b04c1e3c-0d8a-4e27-aa2a-703de0d8d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:13.655411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1170/2356] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:13.660745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2bc12-5664-4e42-88b3-ba82b1ac8b01 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:13.670522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2bc12-5664-4e42-88b3-ba82b1ac8b01 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:13.675310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855df8-285d-47ad-8efc-562d74917d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:13.675962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855df8-285d-47ad-8efc-562d74917d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:13.676249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855df8-285d-47ad-8efc-562d74917d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:13.676529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855df8-285d-47ad-8efc-562d74917d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:13.677255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855df8-285d-47ad-8efc-562d74917d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:13.677562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855df8-285d-47ad-8efc-562d74917d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:13.679185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855df8-285d-47ad-8efc-562d74917d38 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:13.691489 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1187/2357] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:15:13.695862 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c1e3c-0d8a-4e27-aa2a-703de0d8d75e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:13.705121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c1e3c-0d8a-4e27-aa2a-703de0d8d75e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:13.710488 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acedb50-2d8b-4f49-a03a-71a8ba1b517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:13.711146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acedb50-2d8b-4f49-a03a-71a8ba1b517a admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:13.711433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acedb50-2d8b-4f49-a03a-71a8ba1b517a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:13.711712 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acedb50-2d8b-4f49-a03a-71a8ba1b517a admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:13.712417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acedb50-2d8b-4f49-a03a-71a8ba1b517a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:13.714360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acedb50-2d8b-4f49-a03a-71a8ba1b517a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:13.739620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1171/2358] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:13 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:13.743924 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855df8-285d-47ad-8efc-562d74917d38 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:13.755327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855df8-285d-47ad-8efc-562d74917d38 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:13.813538 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7afbfc-d12f-4262-a126-e5b77516a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:13.814306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7afbfc-d12f-4262-a126-e5b77516a0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:13.814599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7afbfc-d12f-4262-a126-e5b77516a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:13.815383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7afbfc-d12f-4262-a126-e5b77516a0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:13.816079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7afbfc-d12f-4262-a126-e5b77516a0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:13.818005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7afbfc-d12f-4262-a126-e5b77516a0a1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:13.838677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1188/2359] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:13 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:13.842878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acedb50-2d8b-4f49-a03a-71a8ba1b517a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:13.864189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acedb50-2d8b-4f49-a03a-71a8ba1b517a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:13.869083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765ea0-e911-465a-8f4f-249b5d3d346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:13.869827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765ea0-e911-465a-8f4f-249b5d3d346f admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:13.870025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765ea0-e911-465a-8f4f-249b5d3d346f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:13.870331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765ea0-e911-465a-8f4f-249b5d3d346f admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:13.871069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33765ea0-e911-465a-8f4f-249b5d3d346f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:13.872666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33765ea0-e911-465a-8f4f-249b5d3d346f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:13.885641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1172/2360] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:13.889861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7afbfc-d12f-4262-a126-e5b77516a0a1 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:13.902844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7afbfc-d12f-4262-a126-e5b77516a0a1 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:13.907915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfae0a6-f1d4-4cfd-ab41-6170fae2678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:13.908752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfae0a6-f1d4-4cfd-ab41-6170fae2678f admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:13.909058 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfae0a6-f1d4-4cfd-ab41-6170fae2678f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:13.909312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfae0a6-f1d4-4cfd-ab41-6170fae2678f admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:13.910046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfae0a6-f1d4-4cfd-ab41-6170fae2678f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:13.911690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfae0a6-f1d4-4cfd-ab41-6170fae2678f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:13.922120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1189/2361] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:13.926348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765ea0-e911-465a-8f4f-249b5d3d346f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:13.936620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765ea0-e911-465a-8f4f-249b5d3d346f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:13.941917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a1c80-69a0-4cc7-ba01-89750fcaf068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:13.942934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a1c80-69a0-4cc7-ba01-89750fcaf068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:13.943259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a1c80-69a0-4cc7-ba01-89750fcaf068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:13.943537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a1c80-69a0-4cc7-ba01-89750fcaf068 admin admin] PATH_INFO: `/v3/projects/1de8754705414039b35b7e3e11ebf483/users/a72f7050083b4bc5bf440e60d18c95c7/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:13.958956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a1c80-69a0-4cc7-ba01-89750fcaf068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de8754705414039b35b7e3e11ebf483, user_id=a72f7050083b4bc5bf440e60d18c95c7, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:13.961623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a1c80-69a0-4cc7-ba01-89750fcaf068 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:13.974291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1173/2362] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:13 2022] PUT /identity/v3/projects/1de8754705414039b35b7e3e11ebf483/users/a72f7050083b4bc5bf440e60d18c95c7/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:13.985918 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75677-b7cc-4fd0-897b-8ddfc0165b35 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:13.986376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75677-b7cc-4fd0-897b-8ddfc0165b35 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:13.986806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead75677-b7cc-4fd0-897b-8ddfc0165b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:14.014954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ead75677-b7cc-4fd0-897b-8ddfc0165b35 None None] MFA Rules not processed for user `a72f7050083b4bc5bf440e60d18c95c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:14.016122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ead75677-b7cc-4fd0-897b-8ddfc0165b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:14.082186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1190/2363] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:14.093139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a1c80-69a0-4cc7-ba01-89750fcaf068 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:14.094892 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a49a1c80-69a0-4cc7-ba01-89750fcaf068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:14.152162 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a1c80-69a0-4cc7-ba01-89750fcaf068 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:14.156844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23951201-6585-4017-a380-7d010e76c5ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:14.157423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951201-6585-4017-a380-7d010e76c5ae service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:14.157734 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951201-6585-4017-a380-7d010e76c5ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:14.158017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23951201-6585-4017-a380-7d010e76c5ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:14.167126 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23951201-6585-4017-a380-7d010e76c5ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:14.168576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23951201-6585-4017-a380-7d010e76c5ae service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:14.173350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:14.178918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1174/2364] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:19.161014 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead75677-b7cc-4fd0-897b-8ddfc0165b35 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:19.163298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ead75677-b7cc-4fd0-897b-8ddfc0165b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:19.228695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:19.318721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead75677-b7cc-4fd0-897b-8ddfc0165b35 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:19.320621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:19.322062 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:19.322751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:19.323317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] PATH_INFO: `/v3/users/e7bd87bcd9b148d899ceb09f9f311ad0` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:19.327332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7bd87bcd9b148d899ceb09f9f311ad0)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:19.331462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:19.410911 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7bd87bcd9b148d899ceb09f9f311ad0'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:19.411648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7bd87bcd9b148d899ceb09f9f311ad0'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:19.412311 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7bd87bcd9b148d899ceb09f9f311ad0'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:19.422316 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7bd87bcd9b148d899ceb09f9f311ad0'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:19.434528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7bd87bcd9b148d899ceb09f9f311ad0'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:19.463883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1191/2365] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:19 2022] DELETE /identity/v3/users/e7bd87bcd9b148d899ceb09f9f311ad0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:19.468756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e618c5-72cb-4ceb-973b-9c8522e92ddd None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:19.469282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e618c5-72cb-4ceb-973b-9c8522e92ddd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:19.469775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e618c5-72cb-4ceb-973b-9c8522e92ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:19.488797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a4e618c5-72cb-4ceb-973b-9c8522e92ddd None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:19.490336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a4e618c5-72cb-4ceb-973b-9c8522e92ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:19.562538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1175/2366] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:19.572193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:19.573631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:19.637530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252a7bf-b8b8-44c7-89e8-f3a9f2cc214c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:19.641680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181f32-cf6f-4c56-ab07-686490fc1008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:19.642424 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181f32-cf6f-4c56-ab07-686490fc1008 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:19.642695 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181f32-cf6f-4c56-ab07-686490fc1008 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:19.643293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181f32-cf6f-4c56-ab07-686490fc1008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:19.658277 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181f32-cf6f-4c56-ab07-686490fc1008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:19.661021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181f32-cf6f-4c56-ab07-686490fc1008 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:19.677926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1192/2367] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:19.895918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e618c5-72cb-4ceb-973b-9c8522e92ddd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:19.897629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a4e618c5-72cb-4ceb-973b-9c8522e92ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:19.912502 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e618c5-72cb-4ceb-973b-9c8522e92ddd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:19.918673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:19.919850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:19.920322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:19.921172 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] PATH_INFO: `/v3/projects/bc773c1e59304cf58c89bfd6707b7ec0` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:19.922578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc773c1e59304cf58c89bfd6707b7ec0)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:19.925446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:19.976292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc773c1e59304cf58c89bfd6707b7ec0', 'request_id': 'req-1332f363-c7f7-4105-936f-b414a3f98a89'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:19.981745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc773c1e59304cf58c89bfd6707b7ec0', 'request_id': 'req-1332f363-c7f7-4105-936f-b414a3f98a89'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:19.989665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc773c1e59304cf58c89bfd6707b7ec0', 'request_id': 'req-1332f363-c7f7-4105-936f-b414a3f98a89'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.001171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] The token cache is being invalidate because project bc773c1e59304cf58c89bfd6707b7ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:20.001458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.002097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1332f363-c7f7-4105-936f-b414a3f98a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.003887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1176/2368] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:19 2022] DELETE /identity/v3/projects/bc773c1e59304cf58c89bfd6707b7ec0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:20.009110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9180-a2dd-42c1-b2c3-b4a487d0291f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.009411 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9180-a2dd-42c1-b2c3-b4a487d0291f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.009700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9180-a2dd-42c1-b2c3-b4a487d0291f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.027095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-372b9180-a2dd-42c1-b2c3-b4a487d0291f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:20.028305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-372b9180-a2dd-42c1-b2c3-b4a487d0291f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:20.070848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:20.092720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1193/2369] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:20.102185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853144af-83a6-45d5-b189-d2828668e537 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.102513 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853144af-83a6-45d5-b189-d2828668e537 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.102811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853144af-83a6-45d5-b189-d2828668e537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.120934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-853144af-83a6-45d5-b189-d2828668e537 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:20.122217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-853144af-83a6-45d5-b189-d2828668e537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:20.131505 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1177/2370] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:20.135911 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b9180-a2dd-42c1-b2c3-b4a487d0291f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:20.147168 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b9180-a2dd-42c1-b2c3-b4a487d0291f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:20.152074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846225f2-009d-4644-a13a-636934024bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:20.152757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846225f2-009d-4644-a13a-636934024bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.153045 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846225f2-009d-4644-a13a-636934024bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.153330 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846225f2-009d-4644-a13a-636934024bdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.154207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846225f2-009d-4644-a13a-636934024bdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:20.154452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846225f2-009d-4644-a13a-636934024bdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:20.156511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846225f2-009d-4644-a13a-636934024bdf admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:20.169733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1194/2371] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:20.174144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853144af-83a6-45d5-b189-d2828668e537 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:20.183458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853144af-83a6-45d5-b189-d2828668e537 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:20.188168 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb22350-30f2-426e-a6ba-92eb2c1796f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:20.188818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb22350-30f2-426e-a6ba-92eb2c1796f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.189101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb22350-30f2-426e-a6ba-92eb2c1796f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.189379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb22350-30f2-426e-a6ba-92eb2c1796f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.190262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb22350-30f2-426e-a6ba-92eb2c1796f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:20.192164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb22350-30f2-426e-a6ba-92eb2c1796f2 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:20.221977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1178/2372] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:20 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:20.226193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846225f2-009d-4644-a13a-636934024bdf admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:20.236980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846225f2-009d-4644-a13a-636934024bdf admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:20.297913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ec4a9-ed64-4cee-8ab5-4bddd63debd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:20.298645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ec4a9-ed64-4cee-8ab5-4bddd63debd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.298988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ec4a9-ed64-4cee-8ab5-4bddd63debd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.299303 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ec4a9-ed64-4cee-8ab5-4bddd63debd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.300166 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ec4a9-ed64-4cee-8ab5-4bddd63debd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:20.302049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ec4a9-ed64-4cee-8ab5-4bddd63debd2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:20.322354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1195/2373] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:20 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:15:20.326583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb22350-30f2-426e-a6ba-92eb2c1796f2 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:20.337774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb22350-30f2-426e-a6ba-92eb2c1796f2 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:20.343609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4c0c2-d1eb-493e-b439-296e935321c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:20.344320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c0c2-d1eb-493e-b439-296e935321c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.344607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c0c2-d1eb-493e-b439-296e935321c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.344888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c0c2-d1eb-493e-b439-296e935321c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.345649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4c0c2-d1eb-493e-b439-296e935321c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:20.347458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ec4a9-ed64-4cee-8ab5-4bddd63debd2 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:20.349196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e63ec4a9-ed64-4cee-8ab5-4bddd63debd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:20.349314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4c0c2-d1eb-493e-b439-296e935321c4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:20.363059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ec4a9-ed64-4cee-8ab5-4bddd63debd2 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:20.364150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1179/2374] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:20.368158 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4c0c2-d1eb-493e-b439-296e935321c4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:20.371136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2020c-ab8c-4e4e-a701-dbbc9c7983f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:20.372023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2020c-ab8c-4e4e-a701-dbbc9c7983f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.372308 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2020c-ab8c-4e4e-a701-dbbc9c7983f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.372586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2020c-ab8c-4e4e-a701-dbbc9c7983f6 admin admin] PATH_INFO: `/v3/users/a6cc226d037e42c09a3e3dc361aa55a4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.373795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2020c-ab8c-4e4e-a701-dbbc9c7983f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6cc226d037e42c09a3e3dc361aa55a4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:20.375838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2020c-ab8c-4e4e-a701-dbbc9c7983f6 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:20.378806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4c0c2-d1eb-493e-b439-296e935321c4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:20.384540 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ba490-0293-48b7-979c-d0e1fc9c72d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:20.385314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ba490-0293-48b7-979c-d0e1fc9c72d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.385602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ba490-0293-48b7-979c-d0e1fc9c72d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.385882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ba490-0293-48b7-979c-d0e1fc9c72d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.387287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ba490-0293-48b7-979c-d0e1fc9c72d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:20.389002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ba490-0293-48b7-979c-d0e1fc9c72d5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:20.401177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1180/2375] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:20.405990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ba490-0293-48b7-979c-d0e1fc9c72d5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:20.418147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ba490-0293-48b7-979c-d0e1fc9c72d5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:20.423685 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707d3f-42d2-4fe1-9271-b962cf0c203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:20.424657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707d3f-42d2-4fe1-9271-b962cf0c203f admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.424941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707d3f-42d2-4fe1-9271-b962cf0c203f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.425223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707d3f-42d2-4fe1-9271-b962cf0c203f admin admin] PATH_INFO: `/v3/projects/b9d19e39b3464b5e804b92c054cb79e9/users/ed549fbe087a43f9a08765f5167d137c/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.442882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9aa2020c-ab8c-4e4e-a701-dbbc9c7983f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6cc226d037e42c09a3e3dc361aa55a4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.443652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707d3f-42d2-4fe1-9271-b962cf0c203f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d19e39b3464b5e804b92c054cb79e9, user_id=ed549fbe087a43f9a08765f5167d137c, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:20.443947 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9aa2020c-ab8c-4e4e-a701-dbbc9c7983f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6cc226d037e42c09a3e3dc361aa55a4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.444919 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9aa2020c-ab8c-4e4e-a701-dbbc9c7983f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6cc226d037e42c09a3e3dc361aa55a4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.447311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707d3f-42d2-4fe1-9271-b962cf0c203f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:20.462034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9aa2020c-ab8c-4e4e-a701-dbbc9c7983f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6cc226d037e42c09a3e3dc361aa55a4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.467141 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1181/2376] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:20 2022] PUT /identity/v3/projects/b9d19e39b3464b5e804b92c054cb79e9/users/ed549fbe087a43f9a08765f5167d137c/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:20.485099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9aa2020c-ab8c-4e4e-a701-dbbc9c7983f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6cc226d037e42c09a3e3dc361aa55a4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.490466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f70f3-3611-484d-be82-e0728d0f49e1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.491347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f70f3-3611-484d-be82-e0728d0f49e1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.492107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f70f3-3611-484d-be82-e0728d0f49e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.519401 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1196/2377] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:20 2022] DELETE /identity/v3/users/a6cc226d037e42c09a3e3dc361aa55a4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:20.523570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:20.523879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365e11-78fb-4f49-a092-ce86c843c64c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.524186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365e11-78fb-4f49-a092-ce86c843c64c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.524457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6365e11-78fb-4f49-a092-ce86c843c64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.543453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-457f70f3-3611-484d-be82-e0728d0f49e1 None None] MFA Rules not processed for user `ed549fbe087a43f9a08765f5167d137c`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:20.545647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-457f70f3-3611-484d-be82-e0728d0f49e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:20.549383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e6365e11-78fb-4f49-a092-ce86c843c64c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:20.550705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e6365e11-78fb-4f49-a092-ce86c843c64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:20.610579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:20.644528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1182/2378] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:20.645614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f70f3-3611-484d-be82-e0728d0f49e1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:20.647645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-457f70f3-3611-484d-be82-e0728d0f49e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:20.663948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1197/2379] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:20.667122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6365e11-78fb-4f49-a092-ce86c843c64c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:20.669318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e6365e11-78fb-4f49-a092-ce86c843c64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:20.733454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f70f3-3611-484d-be82-e0728d0f49e1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:20.738440 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6365e11-78fb-4f49-a092-ce86c843c64c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:20.739300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862011e3-b3a9-44cf-8345-2b08872a9cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:20.740341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862011e3-b3a9-44cf-8345-2b08872a9cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.740730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862011e3-b3a9-44cf-8345-2b08872a9cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.741012 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862011e3-b3a9-44cf-8345-2b08872a9cac admin admin] PATH_INFO: `/v3/users/a72f7050083b4bc5bf440e60d18c95c7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.742109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1de6-c411-427a-bcca-53138908d422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:20.742496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862011e3-b3a9-44cf-8345-2b08872a9cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72f7050083b4bc5bf440e60d18c95c7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:20.742779 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1de6-c411-427a-bcca-53138908d422 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.743063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1de6-c411-427a-bcca-53138908d422 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.743336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1de6-c411-427a-bcca-53138908d422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.744672 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862011e3-b3a9-44cf-8345-2b08872a9cac admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:20.753104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1de6-c411-427a-bcca-53138908d422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:20.754705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1de6-c411-427a-bcca-53138908d422 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:20.766135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1198/2380] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:20.766135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1de6-c411-427a-bcca-53138908d422 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:20.768392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-707a1de6-c411-427a-bcca-53138908d422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:20.809338 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-862011e3-b3a9-44cf-8345-2b08872a9cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72f7050083b4bc5bf440e60d18c95c7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.810613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-862011e3-b3a9-44cf-8345-2b08872a9cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72f7050083b4bc5bf440e60d18c95c7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.811528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-862011e3-b3a9-44cf-8345-2b08872a9cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72f7050083b4bc5bf440e60d18c95c7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.822463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-862011e3-b3a9-44cf-8345-2b08872a9cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72f7050083b4bc5bf440e60d18c95c7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.836035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-862011e3-b3a9-44cf-8345-2b08872a9cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72f7050083b4bc5bf440e60d18c95c7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:20.861014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1183/2381] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:20 2022] DELETE /identity/v3/users/a72f7050083b4bc5bf440e60d18c95c7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:20.863059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000a24-13cf-44e5-b5fb-658ce6bf3993 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.863547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000a24-13cf-44e5-b5fb-658ce6bf3993 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.863987 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb000a24-13cf-44e5-b5fb-658ce6bf3993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.866248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1de6-c411-427a-bcca-53138908d422 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:20.889571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fb000a24-13cf-44e5-b5fb-658ce6bf3993 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:20.891448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fb000a24-13cf-44e5-b5fb-658ce6bf3993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:20.912130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:20.952957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b0ce0-a105-4ae3-8ee1-f5bb4f5860cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:20.953787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0ce0-a105-4ae3-8ee1-f5bb4f5860cd service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:20.954080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0ce0-a105-4ae3-8ee1-f5bb4f5860cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:20.954508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b0ce0-a105-4ae3-8ee1-f5bb4f5860cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:20.958002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1b5b0ce0-a105-4ae3-8ee1-f5bb4f5860cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:20.999952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1184/2382] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:21.015217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb000a24-13cf-44e5-b5fb-658ce6bf3993 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:21.021430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fb000a24-13cf-44e5-b5fb-658ce6bf3993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:21.025112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:21.039707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb000a24-13cf-44e5-b5fb-658ce6bf3993 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:21.049253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10150f09-6ef8-4199-af0e-fe8caa8a55df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:21.051807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10150f09-6ef8-4199-af0e-fe8caa8a55df service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:21.052246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10150f09-6ef8-4199-af0e-fe8caa8a55df service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:21.052710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10150f09-6ef8-4199-af0e-fe8caa8a55df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:21.061492 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b0ce0-a105-4ae3-8ee1-f5bb4f5860cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:21.064117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b0ce0-a105-4ae3-8ee1-f5bb4f5860cd service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:21.065819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10150f09-6ef8-4199-af0e-fe8caa8a55df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:21.067896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10150f09-6ef8-4199-af0e-fe8caa8a55df service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:21.082797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1185/2383] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:21.086218 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1199/2384] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:21.539520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b0ce0-a105-4ae3-8ee1-f5bb4f5860cd service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:21.540264 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10150f09-6ef8-4199-af0e-fe8caa8a55df service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:21.541082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1b5b0ce0-a105-4ae3-8ee1-f5bb4f5860cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:21.542359 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-10150f09-6ef8-4199-af0e-fe8caa8a55df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:21.562948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b0ce0-a105-4ae3-8ee1-f5bb4f5860cd service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:21.570391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:21.576904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10150f09-6ef8-4199-af0e-fe8caa8a55df service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:21.582882 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:21.583266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:21.583555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] PATH_INFO: `/v3/projects/9508e1c6ff7d44b9af75e32e0700f3dd` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:21.586137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9508e1c6ff7d44b9af75e32e0700f3dd)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:21.595210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:21.604594 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:21.606855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:21.607378 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:21.607854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] PATH_INFO: `/v3/projects/1de8754705414039b35b7e3e11ebf483` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:21.610182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de8754705414039b35b7e3e11ebf483)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:21.614499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:21.681203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9508e1c6ff7d44b9af75e32e0700f3dd', 'request_id': 'req-fbaa8658-e7bd-4849-a888-5c1b6bb31979'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:21.686342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de8754705414039b35b7e3e11ebf483', 'request_id': 'req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:21.687671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9508e1c6ff7d44b9af75e32e0700f3dd', 'request_id': 'req-fbaa8658-e7bd-4849-a888-5c1b6bb31979'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:21.692735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de8754705414039b35b7e3e11ebf483', 'request_id': 'req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:21.694193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9508e1c6ff7d44b9af75e32e0700f3dd', 'request_id': 'req-fbaa8658-e7bd-4849-a888-5c1b6bb31979'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:21.703278 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de8754705414039b35b7e3e11ebf483', 'request_id': 'req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:21.711251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] The token cache is being invalidate because project 9508e1c6ff7d44b9af75e32e0700f3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:21.712144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:21.712861 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-fbaa8658-e7bd-4849-a888-5c1b6bb31979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:21.714419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1200/2385] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:21 2022] DELETE /identity/v3/projects/9508e1c6ff7d44b9af75e32e0700f3dd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:21.717768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] The token cache is being invalidate because project 1de8754705414039b35b7e3e11ebf483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:21.718009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:21.719207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406e5d4-b657-43de-835a-1a3ecc1d3b3f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:21.719406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-684fc61d-3fcc-4bd2-b1f6-3befcd8b5d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:21.719528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406e5d4-b657-43de-835a-1a3ecc1d3b3f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:21.719775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406e5d4-b657-43de-835a-1a3ecc1d3b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:21.722230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1186/2386] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:21 2022] DELETE /identity/v3/projects/1de8754705414039b35b7e3e11ebf483 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:21.727803 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe46a8-261d-4818-b3ad-53cb98d425a4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:21.728281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe46a8-261d-4818-b3ad-53cb98d425a4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:21.728599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe46a8-261d-4818-b3ad-53cb98d425a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:21.741839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b406e5d4-b657-43de-835a-1a3ecc1d3b3f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:21.743225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b406e5d4-b657-43de-835a-1a3ecc1d3b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:21.748814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cefe46a8-261d-4818-b3ad-53cb98d425a4 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:21.750133 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cefe46a8-261d-4818-b3ad-53cb98d425a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:21.818012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1201/2387] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:21.825554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa16ff-4841-42dd-97e8-3f5498472525 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:21.825851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa16ff-4841-42dd-97e8-3f5498472525 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:21.826132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa16ff-4841-42dd-97e8-3f5498472525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:21.827062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1187/2388] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:21.835791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eee50-8439-4ae0-8695-ee10a7bd0c83 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:21.836173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eee50-8439-4ae0-8695-ee10a7bd0c83 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:21.836527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eee50-8439-4ae0-8695-ee10a7bd0c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:21.847318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-91aa16ff-4841-42dd-97e8-3f5498472525 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:21.848528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-91aa16ff-4841-42dd-97e8-3f5498472525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:21.858184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1202/2389] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:21.860518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6b6eee50-8439-4ae0-8695-ee10a7bd0c83 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:21.861891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6b6eee50-8439-4ae0-8695-ee10a7bd0c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:21.863172 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa16ff-4841-42dd-97e8-3f5498472525 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:21.871197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1188/2390] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:21.875383 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eee50-8439-4ae0-8695-ee10a7bd0c83 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:21.880332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa16ff-4841-42dd-97e8-3f5498472525 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:21.885966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eee50-8439-4ae0-8695-ee10a7bd0c83 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:21.886925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215b550-1acf-4883-bd24-70f7e5345b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:21.887756 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215b550-1acf-4883-bd24-70f7e5345b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:21.888057 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215b550-1acf-4883-bd24-70f7e5345b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:21.888332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215b550-1acf-4883-bd24-70f7e5345b65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:21.889080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215b550-1acf-4883-bd24-70f7e5345b65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:21.889395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215b550-1acf-4883-bd24-70f7e5345b65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:21.891046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215b550-1acf-4883-bd24-70f7e5345b65 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:21.892104 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869c77d-6ec9-4a53-a73d-453f8e44a5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:21.894148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869c77d-6ec9-4a53-a73d-453f8e44a5ec admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:21.895029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869c77d-6ec9-4a53-a73d-453f8e44a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:21.895439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869c77d-6ec9-4a53-a73d-453f8e44a5ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:21.896685 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869c77d-6ec9-4a53-a73d-453f8e44a5ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:21.896997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869c77d-6ec9-4a53-a73d-453f8e44a5ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:21.899510 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869c77d-6ec9-4a53-a73d-453f8e44a5ec admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:21.907980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1203/2391] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:15:21.912843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215b550-1acf-4883-bd24-70f7e5345b65 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:21.917105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1189/2392] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:21.918174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869c77d-6ec9-4a53-a73d-453f8e44a5ec admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:21.928145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869c77d-6ec9-4a53-a73d-453f8e44a5ec admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:21.929156 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215b550-1acf-4883-bd24-70f7e5345b65 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:21.932718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733f04c-de6a-4644-9aaf-74cdf8300d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:21.933362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733f04c-de6a-4644-9aaf-74cdf8300d06 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:21.933643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733f04c-de6a-4644-9aaf-74cdf8300d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:21.933795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7dcf4-6518-4cf3-bfa6-1920e32fa97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:21.933905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733f04c-de6a-4644-9aaf-74cdf8300d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:21.934487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7dcf4-6518-4cf3-bfa6-1920e32fa97e admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:21.934630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733f04c-de6a-4644-9aaf-74cdf8300d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:21.934773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7dcf4-6518-4cf3-bfa6-1920e32fa97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:21.935052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7dcf4-6518-4cf3-bfa6-1920e32fa97e admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:21.935740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7dcf4-6518-4cf3-bfa6-1920e32fa97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:21.936528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c733f04c-de6a-4644-9aaf-74cdf8300d06 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:21.937631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7dcf4-6518-4cf3-bfa6-1920e32fa97e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:21.941413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:21.966296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1190/2393] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:21 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:21.968689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1204/2394] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:21 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:15:21.970396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733f04c-de6a-4644-9aaf-74cdf8300d06 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:21.972604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7dcf4-6518-4cf3-bfa6-1920e32fa97e admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:21.999580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:22.037929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733f04c-de6a-4644-9aaf-74cdf8300d06 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:22.039442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7dcf4-6518-4cf3-bfa6-1920e32fa97e admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:22.042712 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7796b-7a8a-4863-86d7-9e359a69d42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:22.043388 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7796b-7a8a-4863-86d7-9e359a69d42f admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.043669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7796b-7a8a-4863-86d7-9e359a69d42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.043947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7796b-7a8a-4863-86d7-9e359a69d42f admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.044178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e2f2c-1052-4dd2-93bb-8c039520a452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:22.044647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7796b-7a8a-4863-86d7-9e359a69d42f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:22.044851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e2f2c-1052-4dd2-93bb-8c039520a452 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.045147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e2f2c-1052-4dd2-93bb-8c039520a452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.045428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e2f2c-1052-4dd2-93bb-8c039520a452 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.046122 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e2f2c-1052-4dd2-93bb-8c039520a452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:22.046601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7796b-7a8a-4863-86d7-9e359a69d42f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:22.048071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e2f2c-1052-4dd2-93bb-8c039520a452 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:22.073533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1191/2395] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:21 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:22.073804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1205/2396] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:21 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:15:22.075429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e2f2c-1052-4dd2-93bb-8c039520a452 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:22.075606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7796b-7a8a-4863-86d7-9e359a69d42f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:22.086582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e2f2c-1052-4dd2-93bb-8c039520a452 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:22.086765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7796b-7a8a-4863-86d7-9e359a69d42f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:22.091194 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755d80a-c91a-4ef7-80ad-4fb3d26e0b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:22.091358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9effbce-1674-4d32-9793-bfa4a9bf3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:22.091863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755d80a-c91a-4ef7-80ad-4fb3d26e0b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.091971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effbce-1674-4d32-9793-bfa4a9bf3b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.092149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755d80a-c91a-4ef7-80ad-4fb3d26e0b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.092265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effbce-1674-4d32-9793-bfa4a9bf3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.092427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755d80a-c91a-4ef7-80ad-4fb3d26e0b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.092543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effbce-1674-4d32-9793-bfa4a9bf3b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.093152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755d80a-c91a-4ef7-80ad-4fb3d26e0b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:22.093271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9effbce-1674-4d32-9793-bfa4a9bf3b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:22.094812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755d80a-c91a-4ef7-80ad-4fb3d26e0b32 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:22.094942 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9effbce-1674-4d32-9793-bfa4a9bf3b82 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:22.105739 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1192/2397] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:22.106432 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1206/2398] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:22.110082 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9effbce-1674-4d32-9793-bfa4a9bf3b82 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:22.110526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755d80a-c91a-4ef7-80ad-4fb3d26e0b32 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:22.120334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9effbce-1674-4d32-9793-bfa4a9bf3b82 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:22.120640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755d80a-c91a-4ef7-80ad-4fb3d26e0b32 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:22.125008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de7071-3e7f-486b-bc2f-c76ea8713e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:22.125660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7071-3e7f-486b-bc2f-c76ea8713e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.125887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d5c12-24ee-4652-b4bf-a29db132797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:22.126544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7071-3e7f-486b-bc2f-c76ea8713e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.126651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d5c12-24ee-4652-b4bf-a29db132797c admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.126830 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d5c12-24ee-4652-b4bf-a29db132797c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.126923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de7071-3e7f-486b-bc2f-c76ea8713e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.127757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d5c12-24ee-4652-b4bf-a29db132797c admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.128247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de7071-3e7f-486b-bc2f-c76ea8713e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:22.128758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d5c12-24ee-4652-b4bf-a29db132797c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:22.130316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de7071-3e7f-486b-bc2f-c76ea8713e30 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:22.130714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d5c12-24ee-4652-b4bf-a29db132797c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:22.145101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1207/2399] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:22.145340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1193/2400] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:15:22.146965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d5c12-24ee-4652-b4bf-a29db132797c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:22.148259 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de7071-3e7f-486b-bc2f-c76ea8713e30 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:22.157728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d5c12-24ee-4652-b4bf-a29db132797c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:22.159017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de7071-3e7f-486b-bc2f-c76ea8713e30 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:22.162896 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7f582-732f-4415-a37e-452db2ff2a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:22.163784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7f582-732f-4415-a37e-452db2ff2a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.164070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7f582-732f-4415-a37e-452db2ff2a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.164177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84efe5e-73fa-472b-a2c3-b74cf299a59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:22.164420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7f582-732f-4415-a37e-452db2ff2a10 admin admin] PATH_INFO: `/v3/projects/bdc81783ff1f4a47b617e77618303f94/users/bf2b65c48bc141abbd3c56b791b213ae/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.164978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84efe5e-73fa-472b-a2c3-b74cf299a59a admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.165270 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84efe5e-73fa-472b-a2c3-b74cf299a59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.165549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84efe5e-73fa-472b-a2c3-b74cf299a59a admin admin] PATH_INFO: `/v3/projects/5c6666e112684b9ea973be1c5833b0cb/users/8455bd8a1dd841c6bac62b553f06e683/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.181027 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84efe5e-73fa-472b-a2c3-b74cf299a59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6666e112684b9ea973be1c5833b0cb, user_id=8455bd8a1dd841c6bac62b553f06e683, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:22.182268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7f582-732f-4415-a37e-452db2ff2a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdc81783ff1f4a47b617e77618303f94, user_id=bf2b65c48bc141abbd3c56b791b213ae, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:22.183741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84efe5e-73fa-472b-a2c3-b74cf299a59a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:22.184908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7f582-732f-4415-a37e-452db2ff2a10 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:22.202402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1194/2401] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:22 2022] PUT /identity/v3/projects/5c6666e112684b9ea973be1c5833b0cb/users/8455bd8a1dd841c6bac62b553f06e683/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:22.202603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1208/2402] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:22 2022] PUT /identity/v3/projects/bdc81783ff1f4a47b617e77618303f94/users/bf2b65c48bc141abbd3c56b791b213ae/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:22.203353 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812f993-f6eb-4503-8159-13343423aaab None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.203611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812f993-f6eb-4503-8159-13343423aaab None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.203906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812f993-f6eb-4503-8159-13343423aaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.206277 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412267d5-d94b-42ae-9c82-af4ccd3d5d26 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.206923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412267d5-d94b-42ae-9c82-af4ccd3d5d26 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.207535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412267d5-d94b-42ae-9c82-af4ccd3d5d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.230429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-412267d5-d94b-42ae-9c82-af4ccd3d5d26 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:22.231169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3812f993-f6eb-4503-8159-13343423aaab None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:22.231549 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-412267d5-d94b-42ae-9c82-af4ccd3d5d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:22.232635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3812f993-f6eb-4503-8159-13343423aaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:22.298880 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1209/2403] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:22.309414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412267d5-d94b-42ae-9c82-af4ccd3d5d26 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:22.310913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-412267d5-d94b-42ae-9c82-af4ccd3d5d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:22.320469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1195/2404] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:22.329575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812f993-f6eb-4503-8159-13343423aaab None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:22.331276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3812f993-f6eb-4503-8159-13343423aaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:22.371702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:22.392858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412267d5-d94b-42ae-9c82-af4ccd3d5d26 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:22.398562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380ddbd-c334-4af3-9df6-2147ebadf5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:22.399325 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ddbd-c334-4af3-9df6-2147ebadf5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.399687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ddbd-c334-4af3-9df6-2147ebadf5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.400047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380ddbd-c334-4af3-9df6-2147ebadf5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.411093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812f993-f6eb-4503-8159-13343423aaab None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:22.412193 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380ddbd-c334-4af3-9df6-2147ebadf5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:22.413661 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380ddbd-c334-4af3-9df6-2147ebadf5d8 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:22.415530 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3f522-bcc4-4dfd-b07f-f91f56f2cde1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:22.416458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f522-bcc4-4dfd-b07f-f91f56f2cde1 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:22.416845 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f522-bcc4-4dfd-b07f-f91f56f2cde1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:22.417246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f522-bcc4-4dfd-b07f-f91f56f2cde1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:22.425108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1210/2405] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:22.429014 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3f522-bcc4-4dfd-b07f-f91f56f2cde1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:22.430614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3f522-bcc4-4dfd-b07f-f91f56f2cde1 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:22.442293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1196/2406] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:23.632786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c87d8-d303-4db4-bf2d-00fe83f859c9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:23.634016 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c87d8-d303-4db4-bf2d-00fe83f859c9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:23.634541 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c87d8-d303-4db4-bf2d-00fe83f859c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:23.666446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:23.676915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ff3c87d8-d303-4db4-bf2d-00fe83f859c9 None None] MFA Rules not processed for user `bf2b65c48bc141abbd3c56b791b213ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:23.678139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ff3c87d8-d303-4db4-bf2d-00fe83f859c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:23.781874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1211/2407] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:23.790077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3f522-bcc4-4dfd-b07f-f91f56f2cde1 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:23.792841 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f8f3f522-bcc4-4dfd-b07f-f91f56f2cde1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:23.876557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3f522-bcc4-4dfd-b07f-f91f56f2cde1 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:23.888860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318ac5-a904-4af8-af58-8a26df409369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:23.890671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318ac5-a904-4af8-af58-8a26df409369 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:23.891137 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318ac5-a904-4af8-af58-8a26df409369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:23.891269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57318ac5-a904-4af8-af58-8a26df409369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:23.904379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57318ac5-a904-4af8-af58-8a26df409369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:23.905851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57318ac5-a904-4af8-af58-8a26df409369 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:23.920613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1197/2408] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:27.856509 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ddcbf-3bd5-4488-a1c4-c9fb9f9d6cd9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:27.857043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ddcbf-3bd5-4488-a1c4-c9fb9f9d6cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:27.857043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ddcbf-3bd5-4488-a1c4-c9fb9f9d6cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:27.887833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-793ddcbf-3bd5-4488-a1c4-c9fb9f9d6cd9 None None] MFA Rules not processed for user `8455bd8a1dd841c6bac62b553f06e683`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:27.888409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-793ddcbf-3bd5-4488-a1c4-c9fb9f9d6cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:27.989585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1212/2409] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:27.994120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318ac5-a904-4af8-af58-8a26df409369 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.018614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57318ac5-a904-4af8-af58-8a26df409369 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.023844 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8a69e-36b7-4a19-afc6-63e40bdeb552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.024596 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8a69e-36b7-4a19-afc6-63e40bdeb552 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.024941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8a69e-36b7-4a19-afc6-63e40bdeb552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.025277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8a69e-36b7-4a19-afc6-63e40bdeb552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.026239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8a69e-36b7-4a19-afc6-63e40bdeb552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.028375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd8a69e-36b7-4a19-afc6-63e40bdeb552 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.065879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1198/2410] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:27 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:28.069881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ddcbf-3bd5-4488-a1c4-c9fb9f9d6cd9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.081897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ddcbf-3bd5-4488-a1c4-c9fb9f9d6cd9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.148581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab5da2-a769-454a-96d9-b4f693550c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.149298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5da2-a769-454a-96d9-b4f693550c19 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.149587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5da2-a769-454a-96d9-b4f693550c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.149903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5da2-a769-454a-96d9-b4f693550c19 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.150646 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab5da2-a769-454a-96d9-b4f693550c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.152697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab5da2-a769-454a-96d9-b4f693550c19 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.178321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1213/2411] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:28 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:28.181747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8a69e-36b7-4a19-afc6-63e40bdeb552 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.193537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8a69e-36b7-4a19-afc6-63e40bdeb552 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.204888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f573e2b-8ce0-485f-8d9d-9606436dff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.205846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573e2b-8ce0-485f-8d9d-9606436dff04 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.206136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573e2b-8ce0-485f-8d9d-9606436dff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.206516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f573e2b-8ce0-485f-8d9d-9606436dff04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.207269 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f573e2b-8ce0-485f-8d9d-9606436dff04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.208922 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f573e2b-8ce0-485f-8d9d-9606436dff04 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.225119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1199/2412] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:28.229484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab5da2-a769-454a-96d9-b4f693550c19 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.246108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab5da2-a769-454a-96d9-b4f693550c19 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.251110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f450eea-67b6-40a1-84ef-8613b9a16a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.252082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f450eea-67b6-40a1-84ef-8613b9a16a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.253295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f450eea-67b6-40a1-84ef-8613b9a16a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.253589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f450eea-67b6-40a1-84ef-8613b9a16a12 admin admin] PATH_INFO: `/v3/projects/3abb611c24c84eec9eeaf9fd480b785b/users/22ad0fbc000e4a5d82dfee418ff9b82c/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.276200 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f450eea-67b6-40a1-84ef-8613b9a16a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abb611c24c84eec9eeaf9fd480b785b, user_id=22ad0fbc000e4a5d82dfee418ff9b82c, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.279092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f450eea-67b6-40a1-84ef-8613b9a16a12 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.282689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:28.297583 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1214/2413] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:28 2022] PUT /identity/v3/projects/3abb611c24c84eec9eeaf9fd480b785b/users/22ad0fbc000e4a5d82dfee418ff9b82c/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:28.303694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f573e2b-8ce0-485f-8d9d-9606436dff04 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.314934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f573e2b-8ce0-485f-8d9d-9606436dff04 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.391106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9ed8-ffe2-461c-9c6e-a1dc2f7a63aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.392349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9ed8-ffe2-461c-9c6e-a1dc2f7a63aa admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.392880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9ed8-ffe2-461c-9c6e-a1dc2f7a63aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.398837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9ed8-ffe2-461c-9c6e-a1dc2f7a63aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.401173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f9ed8-ffe2-461c-9c6e-a1dc2f7a63aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.403937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f9ed8-ffe2-461c-9c6e-a1dc2f7a63aa admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.422544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1200/2414] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:28.425090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f450eea-67b6-40a1-84ef-8613b9a16a12 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:28.436172 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f450eea-67b6-40a1-84ef-8613b9a16a12 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:28.441900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af466f86-00a9-4c3d-91e8-c4827c8228c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:28.442940 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af466f86-00a9-4c3d-91e8-c4827c8228c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:28.443233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af466f86-00a9-4c3d-91e8-c4827c8228c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:28.443513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af466f86-00a9-4c3d-91e8-c4827c8228c9 admin admin] PATH_INFO: `/v3/projects/3abb611c24c84eec9eeaf9fd480b785b/users/22ad0fbc000e4a5d82dfee418ff9b82c/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:28.445636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af466f86-00a9-4c3d-91e8-c4827c8228c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abb611c24c84eec9eeaf9fd480b785b, user_id=22ad0fbc000e4a5d82dfee418ff9b82c, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:28.448344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af466f86-00a9-4c3d-91e8-c4827c8228c9 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:28.461667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1215/2415] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:28 2022] PUT /identity/v3/projects/3abb611c24c84eec9eeaf9fd480b785b/users/22ad0fbc000e4a5d82dfee418ff9b82c/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:29.645113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83779cf-3458-45ed-b517-a87c52035340 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:29.645599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83779cf-3458-45ed-b517-a87c52035340 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:29.646020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83779cf-3458-45ed-b517-a87c52035340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:29.682064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c83779cf-3458-45ed-b517-a87c52035340 None None] MFA Rules not processed for user `bf2b65c48bc141abbd3c56b791b213ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:29.683356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c83779cf-3458-45ed-b517-a87c52035340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:29.745202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:29.781311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1201/2416] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:34.613528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f4f34-5e3a-4058-95fc-e3115fd89b03 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:34.614063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f4f34-5e3a-4058-95fc-e3115fd89b03 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:34.614316 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f4f34-5e3a-4058-95fc-e3115fd89b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:34.648842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a13f4f34-5e3a-4058-95fc-e3115fd89b03 None None] MFA Rules not processed for user `22ad0fbc000e4a5d82dfee418ff9b82c`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:34.650220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a13f4f34-5e3a-4058-95fc-e3115fd89b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:34.754985 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1216/2417] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:34.771484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83779cf-3458-45ed-b517-a87c52035340 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:34.773116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c83779cf-3458-45ed-b517-a87c52035340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:34.893781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83779cf-3458-45ed-b517-a87c52035340 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:34.907229 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6012b-bb29-4888-9b13-093917576cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:34.907959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6012b-bb29-4888-9b13-093917576cbf service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:34.909718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6012b-bb29-4888-9b13-093917576cbf service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:34.909718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6012b-bb29-4888-9b13-093917576cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:34.972445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6012b-bb29-4888-9b13-093917576cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:34.974092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6012b-bb29-4888-9b13-093917576cbf service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:34.986741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1202/2418] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:36.283471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c73c4-5ab9-4f0b-8d5e-3cb727384479 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:36.283992 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c73c4-5ab9-4f0b-8d5e-3cb727384479 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:36.284124 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c73c4-5ab9-4f0b-8d5e-3cb727384479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:36.305838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-8c6c73c4-5ab9-4f0b-8d5e-3cb727384479 None None] MFA Rules not processed for user `8455bd8a1dd841c6bac62b553f06e683`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:36.307107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8c6c73c4-5ab9-4f0b-8d5e-3cb727384479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:36.314741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1217/2419] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:40.495073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6012b-bb29-4888-9b13-093917576cbf service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:40.496557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dce6012b-bb29-4888-9b13-093917576cbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:40.567092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6012b-bb29-4888-9b13-093917576cbf service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:40.571660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:40.572556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:40.572834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:40.573103 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] PATH_INFO: `/v3/users/2a84dc47627443108da7210e51a8dcff` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:40.574366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a84dc47627443108da7210e51a8dcff)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:40.576322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:40.603196 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:40.638499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a84dc47627443108da7210e51a8dcff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:40.639569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a84dc47627443108da7210e51a8dcff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:40.640441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a84dc47627443108da7210e51a8dcff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:40.650703 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a84dc47627443108da7210e51a8dcff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:40.669749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a84dc47627443108da7210e51a8dcff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:40.685778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1203/2420] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:40 2022] DELETE /identity/v3/users/2a84dc47627443108da7210e51a8dcff => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:40.691365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd2d0e-7c1e-47e0-9a53-5c03f6a05349 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:40.691925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd2d0e-7c1e-47e0-9a53-5c03f6a05349 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:40.691925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd2d0e-7c1e-47e0-9a53-5c03f6a05349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:40.712178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-01dd2d0e-7c1e-47e0-9a53-5c03f6a05349 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:40.713412 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-01dd2d0e-7c1e-47e0-9a53-5c03f6a05349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:40.815817 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1218/2421] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:40.826395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:40.827582 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:40.909937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d1aa1-34c9-4cac-a8cb-3a0ac503bf1d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:40.917330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8694eeb-b0dc-47ff-b928-e337853577b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:40.918995 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8694eeb-b0dc-47ff-b928-e337853577b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:40.919521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8694eeb-b0dc-47ff-b928-e337853577b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:40.920017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8694eeb-b0dc-47ff-b928-e337853577b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:40.932994 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8694eeb-b0dc-47ff-b928-e337853577b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:40.934592 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8694eeb-b0dc-47ff-b928-e337853577b6 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:40.948529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1204/2422] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:41.455866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd2d0e-7c1e-47e0-9a53-5c03f6a05349 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:41.457543 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-01dd2d0e-7c1e-47e0-9a53-5c03f6a05349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:41.471233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd2d0e-7c1e-47e0-9a53-5c03f6a05349 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:41.477933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:41.479074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.479513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.479961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] PATH_INFO: `/v3/projects/f15a48d2b05842809e50e75c9f5bfcb5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.481815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15a48d2b05842809e50e75c9f5bfcb5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:41.484778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:41.545038 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15a48d2b05842809e50e75c9f5bfcb5', 'request_id': 'req-8211dda8-fb01-42e8-a81b-e0a4af71e930'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:41.553612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15a48d2b05842809e50e75c9f5bfcb5', 'request_id': 'req-8211dda8-fb01-42e8-a81b-e0a4af71e930'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:41.555908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:41.560346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15a48d2b05842809e50e75c9f5bfcb5', 'request_id': 'req-8211dda8-fb01-42e8-a81b-e0a4af71e930'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:41.576405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] The token cache is being invalidate because project f15a48d2b05842809e50e75c9f5bfcb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:41.576762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:41.577650 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-8211dda8-fb01-42e8-a81b-e0a4af71e930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:41.580555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1219/2423] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:41 2022] DELETE /identity/v3/projects/f15a48d2b05842809e50e75c9f5bfcb5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:41.585529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9b2a-7f0e-41cf-96cd-5436f4abb4b7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.586050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9b2a-7f0e-41cf-96cd-5436f4abb4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.586297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9b2a-7f0e-41cf-96cd-5436f4abb4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.607776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e41e9b2a-7f0e-41cf-96cd-5436f4abb4b7 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:41.609190 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e41e9b2a-7f0e-41cf-96cd-5436f4abb4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:41.706560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1205/2424] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:41.714377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633628ea-cc20-434c-8381-9ddc44e5e14e None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.714932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633628ea-cc20-434c-8381-9ddc44e5e14e None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.714932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633628ea-cc20-434c-8381-9ddc44e5e14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.734951 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-633628ea-cc20-434c-8381-9ddc44e5e14e None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:41.737190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-633628ea-cc20-434c-8381-9ddc44e5e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:41.753503 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1220/2425] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:41.758136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e9b2a-7f0e-41cf-96cd-5436f4abb4b7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:41.768966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e9b2a-7f0e-41cf-96cd-5436f4abb4b7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:41.779726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021378e-4789-4f74-92d3-161fe3ef425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:41.780442 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021378e-4789-4f74-92d3-161fe3ef425b admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.780732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021378e-4789-4f74-92d3-161fe3ef425b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.781013 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021378e-4789-4f74-92d3-161fe3ef425b admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.781790 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021378e-4789-4f74-92d3-161fe3ef425b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:41.782695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021378e-4789-4f74-92d3-161fe3ef425b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:41.784418 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021378e-4789-4f74-92d3-161fe3ef425b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:41.797325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1206/2426] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:41.802834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633628ea-cc20-434c-8381-9ddc44e5e14e None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:41.812306 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633628ea-cc20-434c-8381-9ddc44e5e14e None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:41.817485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5a98c-0d78-4831-8a38-1bab97059e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:41.818148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a98c-0d78-4831-8a38-1bab97059e3d admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.818464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a98c-0d78-4831-8a38-1bab97059e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.818741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a98c-0d78-4831-8a38-1bab97059e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.819448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5a98c-0d78-4831-8a38-1bab97059e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:41.821344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5a98c-0d78-4831-8a38-1bab97059e3d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:41.853379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1221/2427] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:41 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:41.856544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021378e-4789-4f74-92d3-161fe3ef425b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:41.869969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021378e-4789-4f74-92d3-161fe3ef425b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:41.903903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:41.950316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1dd94-d65d-4f5e-9462-6df0e5131a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:41.951016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1dd94-d65d-4f5e-9462-6df0e5131a2d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:41.951314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1dd94-d65d-4f5e-9462-6df0e5131a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:41.951594 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1dd94-d65d-4f5e-9462-6df0e5131a2d admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:41.952309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1dd94-d65d-4f5e-9462-6df0e5131a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:41.955601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1dd94-d65d-4f5e-9462-6df0e5131a2d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:41.980890 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1207/2428] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:41 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:15:41.985136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5a98c-0d78-4831-8a38-1bab97059e3d admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:41.996601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5a98c-0d78-4831-8a38-1bab97059e3d admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:42.003649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec4f9f-d536-4052-8ab5-1f3a97269096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:42.005320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec4f9f-d536-4052-8ab5-1f3a97269096 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.005706 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec4f9f-d536-4052-8ab5-1f3a97269096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.006138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec4f9f-d536-4052-8ab5-1f3a97269096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.008137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec4f9f-d536-4052-8ab5-1f3a97269096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:42.009957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec4f9f-d536-4052-8ab5-1f3a97269096 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:42.046602 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1222/2429] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:42.048957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1dd94-d65d-4f5e-9462-6df0e5131a2d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:42.061449 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1dd94-d65d-4f5e-9462-6df0e5131a2d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:42.066757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99025316-6d7b-4369-adb5-eca8b2f2e704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:42.067463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99025316-6d7b-4369-adb5-eca8b2f2e704 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.067750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99025316-6d7b-4369-adb5-eca8b2f2e704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.068034 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99025316-6d7b-4369-adb5-eca8b2f2e704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.068794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99025316-6d7b-4369-adb5-eca8b2f2e704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:42.070964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99025316-6d7b-4369-adb5-eca8b2f2e704 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:42.084789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1208/2430] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:42.091121 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec4f9f-d536-4052-8ab5-1f3a97269096 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:42.103917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec4f9f-d536-4052-8ab5-1f3a97269096 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:42.126901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47b4b-f0b4-4a54-b87f-0542b7bde13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:42.127907 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47b4b-f0b4-4a54-b87f-0542b7bde13b admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.129107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47b4b-f0b4-4a54-b87f-0542b7bde13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.131106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47b4b-f0b4-4a54-b87f-0542b7bde13b admin admin] PATH_INFO: `/v3/projects/c7fab5e31bbc44c99cdb801167338036/users/7d88ca596a4d4994bfc43ac38fdccc39/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.155868 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47b4b-f0b4-4a54-b87f-0542b7bde13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fab5e31bbc44c99cdb801167338036, user_id=7d88ca596a4d4994bfc43ac38fdccc39, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:42.159668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47b4b-f0b4-4a54-b87f-0542b7bde13b admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:42.179433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1223/2431] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:42 2022] PUT /identity/v3/projects/c7fab5e31bbc44c99cdb801167338036/users/7d88ca596a4d4994bfc43ac38fdccc39/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:42.262000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ad9f3-7970-4d85-847a-8036169a9cee None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.262411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ad9f3-7970-4d85-847a-8036169a9cee None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.262625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ad9f3-7970-4d85-847a-8036169a9cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.317506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-495ad9f3-7970-4d85-847a-8036169a9cee None None] MFA Rules not processed for user `7d88ca596a4d4994bfc43ac38fdccc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:42.318872 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-495ad9f3-7970-4d85-847a-8036169a9cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:42.438011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1209/2432] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:42.455645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47b4b-f0b4-4a54-b87f-0542b7bde13b admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:42.457704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-66c47b4b-f0b4-4a54-b87f-0542b7bde13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:42.538644 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47b4b-f0b4-4a54-b87f-0542b7bde13b admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:42.542356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f885d-27ec-4c2f-b5a0-dcf175c87d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:42.543010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f885d-27ec-4c2f-b5a0-dcf175c87d02 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.543297 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f885d-27ec-4c2f-b5a0-dcf175c87d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.543580 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f885d-27ec-4c2f-b5a0-dcf175c87d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.553705 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f885d-27ec-4c2f-b5a0-dcf175c87d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:42.555059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f885d-27ec-4c2f-b5a0-dcf175c87d02 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:42.565279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1224/2433] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:42.590633 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ad9f3-7970-4d85-847a-8036169a9cee None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:42.661640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ad9f3-7970-4d85-847a-8036169a9cee None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:42.666504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:42.667396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.667683 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.667967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] PATH_INFO: `/v3/users/7d88ca596a4d4994bfc43ac38fdccc39` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.669199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d88ca596a4d4994bfc43ac38fdccc39)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:42.672946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:42.729835 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:42.736156 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d88ca596a4d4994bfc43ac38fdccc39'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:42.737612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d88ca596a4d4994bfc43ac38fdccc39'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:42.738579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d88ca596a4d4994bfc43ac38fdccc39'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:42.749877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d88ca596a4d4994bfc43ac38fdccc39'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:42.773817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d88ca596a4d4994bfc43ac38fdccc39'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:42.795091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1210/2434] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:42 2022] DELETE /identity/v3/users/7d88ca596a4d4994bfc43ac38fdccc39 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:42.801333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e3ce0-ecf4-4775-b48f-a2f674de5c7f None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:42.802453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e3ce0-ecf4-4775-b48f-a2f674de5c7f None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:42.803104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e3ce0-ecf4-4775-b48f-a2f674de5c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:42.824051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-070e3ce0-ecf4-4775-b48f-a2f674de5c7f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:42.825553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-070e3ce0-ecf4-4775-b48f-a2f674de5c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:42.904096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1225/2435] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:42.916409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:42.919061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:43.029639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fcf26-5aa6-4d91-b4a7-341100834e0a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:43.038185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36736985-64ae-4b2a-a7f6-47e09f57816e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:43.038715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736985-64ae-4b2a-a7f6-47e09f57816e service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:43.039002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736985-64ae-4b2a-a7f6-47e09f57816e service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:43.039277 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736985-64ae-4b2a-a7f6-47e09f57816e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:43.050717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36736985-64ae-4b2a-a7f6-47e09f57816e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:43.052228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36736985-64ae-4b2a-a7f6-47e09f57816e service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:43.066148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1211/2436] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:43.225817 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e3ce0-ecf4-4775-b48f-a2f674de5c7f None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:43.227333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-070e3ce0-ecf4-4775-b48f-a2f674de5c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:43.243270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e3ce0-ecf4-4775-b48f-a2f674de5c7f None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:43.248182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:43.249084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:43.249378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:43.249662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] PATH_INFO: `/v3/users/ed549fbe087a43f9a08765f5167d137c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:43.251475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed549fbe087a43f9a08765f5167d137c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:43.253444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:43.289253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:43.344114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed549fbe087a43f9a08765f5167d137c'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:43.345011 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed549fbe087a43f9a08765f5167d137c'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:43.345698 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed549fbe087a43f9a08765f5167d137c'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:43.354988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed549fbe087a43f9a08765f5167d137c'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:43.364903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed549fbe087a43f9a08765f5167d137c'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:43.392056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1226/2437] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:43 2022] DELETE /identity/v3/users/ed549fbe087a43f9a08765f5167d137c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:43.396845 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b031e-1ba6-4cfb-b95f-638435d2be78 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:43.397175 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b031e-1ba6-4cfb-b95f-638435d2be78 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:43.397461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019b031e-1ba6-4cfb-b95f-638435d2be78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:43.415159 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:43.416949 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:43.424062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-019b031e-1ba6-4cfb-b95f-638435d2be78 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:43.425747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-019b031e-1ba6-4cfb-b95f-638435d2be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:43.523299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b060185-dbe1-4f70-b307-8a5575f9e2ff admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:43.528462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:43.529512 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:43.529902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:43.530310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] PATH_INFO: `/v3/projects/c7fab5e31bbc44c99cdb801167338036` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:43.530592 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1212/2438] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:43.532164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fab5e31bbc44c99cdb801167338036)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:43.534588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:43.547427 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b031e-1ba6-4cfb-b95f-638435d2be78 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:43.550424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-019b031e-1ba6-4cfb-b95f-638435d2be78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:43.613819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fab5e31bbc44c99cdb801167338036', 'request_id': 'req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:43.622069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fab5e31bbc44c99cdb801167338036', 'request_id': 'req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:43.629747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fab5e31bbc44c99cdb801167338036', 'request_id': 'req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:43.649340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] The token cache is being invalidate because project c7fab5e31bbc44c99cdb801167338036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:43.649640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:43.650347 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:43.652082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1227/2439] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:43 2022] DELETE /identity/v3/projects/c7fab5e31bbc44c99cdb801167338036 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:43.680966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019b031e-1ba6-4cfb-b95f-638435d2be78 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:43.712901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:43.762571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896988a5-db55-49bc-98d0-c46f69ffbb69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:43.763193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896988a5-db55-49bc-98d0-c46f69ffbb69 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:43.763621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896988a5-db55-49bc-98d0-c46f69ffbb69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:43.763966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896988a5-db55-49bc-98d0-c46f69ffbb69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:43.765827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-896988a5-db55-49bc-98d0-c46f69ffbb69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:43.839596 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896988a5-db55-49bc-98d0-c46f69ffbb69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:43.841078 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896988a5-db55-49bc-98d0-c46f69ffbb69 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:43.852181 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1213/2440] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:15:44.156742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:44.158463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:44.177746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f5c0-6c7e-426d-b002-21a715d07d4e admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:44.184458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:44.185752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.186144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.186528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] PATH_INFO: `/v3/projects/b9d19e39b3464b5e804b92c054cb79e9` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.188055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d19e39b3464b5e804b92c054cb79e9)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:44.190753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:44.222625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:44.249185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d19e39b3464b5e804b92c054cb79e9', 'request_id': 'req-bf0f1bbb-e239-4e85-9087-e54285034cc8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:44.256357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d19e39b3464b5e804b92c054cb79e9', 'request_id': 'req-bf0f1bbb-e239-4e85-9087-e54285034cc8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:44.261914 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d19e39b3464b5e804b92c054cb79e9', 'request_id': 'req-bf0f1bbb-e239-4e85-9087-e54285034cc8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:44.273821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] The token cache is being invalidate because project b9d19e39b3464b5e804b92c054cb79e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:44.274050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:44.274728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-bf0f1bbb-e239-4e85-9087-e54285034cc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:44.276283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1228/2441] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:44 2022] DELETE /identity/v3/projects/b9d19e39b3464b5e804b92c054cb79e9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:44.281407 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1769144-2620-427b-a2df-dcd90340ae7c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.281707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1769144-2620-427b-a2df-dcd90340ae7c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.281992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1769144-2620-427b-a2df-dcd90340ae7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.300666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d1769144-2620-427b-a2df-dcd90340ae7c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:44.301895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d1769144-2620-427b-a2df-dcd90340ae7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:44.361359 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1214/2442] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:44.369274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc43c-1d14-42bd-a0d6-b89ef24de76d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.369582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc43c-1d14-42bd-a0d6-b89ef24de76d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.369853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc43c-1d14-42bd-a0d6-b89ef24de76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.392973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-93dcc43c-1d14-42bd-a0d6-b89ef24de76d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:44.394286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-93dcc43c-1d14-42bd-a0d6-b89ef24de76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:44.403115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1229/2443] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:44.408037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1769144-2620-427b-a2df-dcd90340ae7c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:44.418856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1769144-2620-427b-a2df-dcd90340ae7c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:44.424471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037cfd7-e903-4ce3-8cd0-4f640d47a314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:44.425147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037cfd7-e903-4ce3-8cd0-4f640d47a314 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.425434 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037cfd7-e903-4ce3-8cd0-4f640d47a314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.425714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037cfd7-e903-4ce3-8cd0-4f640d47a314 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.426499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037cfd7-e903-4ce3-8cd0-4f640d47a314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:15:44.426836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037cfd7-e903-4ce3-8cd0-4f640d47a314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:44.428539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037cfd7-e903-4ce3-8cd0-4f640d47a314 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:44.441868 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1215/2444] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:15:44.445737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcc43c-1d14-42bd-a0d6-b89ef24de76d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:44.455722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcc43c-1d14-42bd-a0d6-b89ef24de76d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:44.460703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fcb62-f26a-4705-8e36-ee07264eac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:44.461373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fcb62-f26a-4705-8e36-ee07264eac88 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.461691 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fcb62-f26a-4705-8e36-ee07264eac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.461971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fcb62-f26a-4705-8e36-ee07264eac88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.462714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fcb62-f26a-4705-8e36-ee07264eac88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:44.464683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fcb62-f26a-4705-8e36-ee07264eac88 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:44.496095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1230/2445] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:44 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:44.500489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037cfd7-e903-4ce3-8cd0-4f640d47a314 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:44.511516 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037cfd7-e903-4ce3-8cd0-4f640d47a314 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:44.568424 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:44.576133 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d051542-7d1b-4812-adae-5cd0b521687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:44.576810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d051542-7d1b-4812-adae-5cd0b521687c admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.577092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d051542-7d1b-4812-adae-5cd0b521687c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.577378 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d051542-7d1b-4812-adae-5cd0b521687c admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.578110 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d051542-7d1b-4812-adae-5cd0b521687c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:44.580397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d051542-7d1b-4812-adae-5cd0b521687c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:44.601117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1216/2446] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:44 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:44.605488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fcb62-f26a-4705-8e36-ee07264eac88 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:44.616934 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fcb62-f26a-4705-8e36-ee07264eac88 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:44.621778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c6b83-1ebb-439f-a1ba-525bf483872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:44.622500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6b83-1ebb-439f-a1ba-525bf483872c admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.622789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6b83-1ebb-439f-a1ba-525bf483872c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.623069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6b83-1ebb-439f-a1ba-525bf483872c admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.623802 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c6b83-1ebb-439f-a1ba-525bf483872c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:44.625403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c6b83-1ebb-439f-a1ba-525bf483872c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:44.636376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1231/2447] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:44.640556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d051542-7d1b-4812-adae-5cd0b521687c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:44.650884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d051542-7d1b-4812-adae-5cd0b521687c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:44.655856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683e27c-1bbe-4155-b071-b702eb508d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:44.656618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683e27c-1bbe-4155-b071-b702eb508d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.658260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683e27c-1bbe-4155-b071-b702eb508d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.658615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683e27c-1bbe-4155-b071-b702eb508d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.659415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683e27c-1bbe-4155-b071-b702eb508d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:44.661234 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683e27c-1bbe-4155-b071-b702eb508d86 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:44.673378 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1217/2448] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:44.678974 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c6b83-1ebb-439f-a1ba-525bf483872c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:44.689858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c6b83-1ebb-439f-a1ba-525bf483872c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:44.694673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff723bc-0d12-4b6a-ad75-240ab3e14f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:44.695572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff723bc-0d12-4b6a-ad75-240ab3e14f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.695865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff723bc-0d12-4b6a-ad75-240ab3e14f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.696151 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff723bc-0d12-4b6a-ad75-240ab3e14f8b admin admin] PATH_INFO: `/v3/projects/8da67a5ec9194e7bad1eb52c45a584bf/users/5383a1d1bec34094a1889a86d87a88b5/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.711656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff723bc-0d12-4b6a-ad75-240ab3e14f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da67a5ec9194e7bad1eb52c45a584bf, user_id=5383a1d1bec34094a1889a86d87a88b5, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:44.714376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff723bc-0d12-4b6a-ad75-240ab3e14f8b admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:44.730455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1232/2449] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:44 2022] PUT /identity/v3/projects/8da67a5ec9194e7bad1eb52c45a584bf/users/5383a1d1bec34094a1889a86d87a88b5/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:15:44.739156 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bbaf5-143a-4679-ae77-2f9de2e353f1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.739788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bbaf5-143a-4679-ae77-2f9de2e353f1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.740393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bbaf5-143a-4679-ae77-2f9de2e353f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.768776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fb2bbaf5-143a-4679-ae77-2f9de2e353f1 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:44.770945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fb2bbaf5-143a-4679-ae77-2f9de2e353f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:44.869760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1218/2450] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:44.883662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff723bc-0d12-4b6a-ad75-240ab3e14f8b admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:44.889259 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8ff723bc-0d12-4b6a-ad75-240ab3e14f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:44.971724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff723bc-0d12-4b6a-ad75-240ab3e14f8b admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:44.976579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eee83e-f86f-474d-8a2a-9a093a09aaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:44.977269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee83e-f86f-474d-8a2a-9a093a09aaaa service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:44.977588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee83e-f86f-474d-8a2a-9a093a09aaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:44.977874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee83e-f86f-474d-8a2a-9a093a09aaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:44.988133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eee83e-f86f-474d-8a2a-9a093a09aaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:44.989613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eee83e-f86f-474d-8a2a-9a093a09aaaa service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:44.999572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1233/2451] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:50.180887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c29e0-833f-4efc-b64e-7f6d5535afb1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.181359 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c29e0-833f-4efc-b64e-7f6d5535afb1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.181443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c29e0-833f-4efc-b64e-7f6d5535afb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.224937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c40c29e0-833f-4efc-b64e-7f6d5535afb1 None None] MFA Rules not processed for user `5383a1d1bec34094a1889a86d87a88b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:50.226425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c40c29e0-833f-4efc-b64e-7f6d5535afb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:50.302763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1219/2452] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:50.307855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eee83e-f86f-474d-8a2a-9a093a09aaaa service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:50.320668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eee83e-f86f-474d-8a2a-9a093a09aaaa service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:50.325436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e974e75-977d-4698-a8fd-5506765b7e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:50.326216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e974e75-977d-4698-a8fd-5506765b7e8e admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.326582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e974e75-977d-4698-a8fd-5506765b7e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.326932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e974e75-977d-4698-a8fd-5506765b7e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.327708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e974e75-977d-4698-a8fd-5506765b7e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:50.330766 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e974e75-977d-4698-a8fd-5506765b7e8e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:50.364152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1234/2453] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:15:50 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:50.365289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c29e0-833f-4efc-b64e-7f6d5535afb1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:50.376213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c29e0-833f-4efc-b64e-7f6d5535afb1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:50.461645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09868d-d452-4315-997c-4953a2827f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:50.462542 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09868d-d452-4315-997c-4953a2827f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.462837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09868d-d452-4315-997c-4953a2827f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.463150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09868d-d452-4315-997c-4953a2827f0b admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.463907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09868d-d452-4315-997c-4953a2827f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:50.466071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09868d-d452-4315-997c-4953a2827f0b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:50.476314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:50.495447 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1220/2454] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:15:50 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:15:50.500277 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e974e75-977d-4698-a8fd-5506765b7e8e admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:50.520701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e974e75-977d-4698-a8fd-5506765b7e8e admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:50.531901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a80e12-6b8f-4635-a7d0-f7198599f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:50.532601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a80e12-6b8f-4635-a7d0-f7198599f651 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.532884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a80e12-6b8f-4635-a7d0-f7198599f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.533165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a80e12-6b8f-4635-a7d0-f7198599f651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.533919 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a80e12-6b8f-4635-a7d0-f7198599f651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:50.535731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a80e12-6b8f-4635-a7d0-f7198599f651 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:50.555737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1235/2455] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:50.560620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09868d-d452-4315-997c-4953a2827f0b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:50.577000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09868d-d452-4315-997c-4953a2827f0b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:50.583971 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45f2bd-73e5-41f6-89db-7d7c86dd475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:50.585654 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f2bd-73e5-41f6-89db-7d7c86dd475f admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.586108 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f2bd-73e5-41f6-89db-7d7c86dd475f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.586570 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45f2bd-73e5-41f6-89db-7d7c86dd475f admin admin] PATH_INFO: `/v3/projects/d13b29f30cc24092abf3980ba5e312f9/users/74c2e8ea86364da787eeace1a2fe2ae8/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.619631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45f2bd-73e5-41f6-89db-7d7c86dd475f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13b29f30cc24092abf3980ba5e312f9, user_id=74c2e8ea86364da787eeace1a2fe2ae8, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:50.619631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45f2bd-73e5-41f6-89db-7d7c86dd475f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:50.643991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1221/2456] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:50 2022] PUT /identity/v3/projects/d13b29f30cc24092abf3980ba5e312f9/users/74c2e8ea86364da787eeace1a2fe2ae8/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:50.647923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a80e12-6b8f-4635-a7d0-f7198599f651 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:50.669741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a80e12-6b8f-4635-a7d0-f7198599f651 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:50.693268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:50.762654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ce2a6-837e-4c94-a4e2-e1c2baf48b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:50.762888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ce2a6-837e-4c94-a4e2-e1c2baf48b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.763090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ce2a6-837e-4c94-a4e2-e1c2baf48b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.763350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ce2a6-837e-4c94-a4e2-e1c2baf48b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.764098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ce2a6-837e-4c94-a4e2-e1c2baf48b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:50.766200 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ce2a6-837e-4c94-a4e2-e1c2baf48b93 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:50.778637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1236/2457] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:15:50.783473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45f2bd-73e5-41f6-89db-7d7c86dd475f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:50.794916 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45f2bd-73e5-41f6-89db-7d7c86dd475f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:50.827645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbc8ae-d784-4715-bd96-95a8b2ce7049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:50.827907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbc8ae-d784-4715-bd96-95a8b2ce7049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:50.828244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbc8ae-d784-4715-bd96-95a8b2ce7049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:50.829503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbc8ae-d784-4715-bd96-95a8b2ce7049 admin admin] PATH_INFO: `/v3/projects/d13b29f30cc24092abf3980ba5e312f9/users/74c2e8ea86364da787eeace1a2fe2ae8/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:50.836893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbc8ae-d784-4715-bd96-95a8b2ce7049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13b29f30cc24092abf3980ba5e312f9, user_id=74c2e8ea86364da787eeace1a2fe2ae8, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:50.842280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbc8ae-d784-4715-bd96-95a8b2ce7049 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:50.873309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1222/2458] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:15:50 2022] PUT /identity/v3/projects/d13b29f30cc24092abf3980ba5e312f9/users/74c2e8ea86364da787eeace1a2fe2ae8/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:52.262466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ce2a6-837e-4c94-a4e2-e1c2baf48b93 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:52.264441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-118ce2a6-837e-4c94-a4e2-e1c2baf48b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:52.290527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ce2a6-837e-4c94-a4e2-e1c2baf48b93 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:52.385804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:52.386710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:52.387466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:52.387764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] PATH_INFO: `/v3/users/64f22cc3b8bb45d0bcf2c07ef9ccc057` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:52.391318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f22cc3b8bb45d0bcf2c07ef9ccc057)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:52.395936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:52.484975 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f22cc3b8bb45d0bcf2c07ef9ccc057'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:52.485929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f22cc3b8bb45d0bcf2c07ef9ccc057'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:52.486982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f22cc3b8bb45d0bcf2c07ef9ccc057'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:52.496350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f22cc3b8bb45d0bcf2c07ef9ccc057'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:52.508263 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f22cc3b8bb45d0bcf2c07ef9ccc057'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:52.551384 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1237/2459] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:15:52 2022] DELETE /identity/v3/users/64f22cc3b8bb45d0bcf2c07ef9ccc057 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:52.553016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f03dc2-16bd-47da-85ff-a9ce896c6a2f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:52.553522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f03dc2-16bd-47da-85ff-a9ce896c6a2f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:52.553767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f03dc2-16bd-47da-85ff-a9ce896c6a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:52.574495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-76f03dc2-16bd-47da-85ff-a9ce896c6a2f None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:52.575979 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-76f03dc2-16bd-47da-85ff-a9ce896c6a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:52.653188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1223/2460] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:15:52.693080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:52.696349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:52.792239 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:15:52.835904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f88c35-896c-4004-8c7f-0cb73b847f5d admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:52.840149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993c288-dc90-4a39-8c10-39747c860f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:52.840906 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993c288-dc90-4a39-8c10-39747c860f0f service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:52.841208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993c288-dc90-4a39-8c10-39747c860f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:52.841492 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993c288-dc90-4a39-8c10-39747c860f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:52.855343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993c288-dc90-4a39-8c10-39747c860f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:52.857217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993c288-dc90-4a39-8c10-39747c860f0f service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:52.874815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1238/2461] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:15:53.266988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fec63-6421-4579-a698-4866fb9b575f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:53.267109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fec63-6421-4579-a698-4866fb9b575f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:53.267718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fec63-6421-4579-a698-4866fb9b575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:53.295998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-972fec63-6421-4579-a698-4866fb9b575f None None] MFA Rules not processed for user `39a5cea0a591453581a9d98ff796d973`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:53.300808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-972fec63-6421-4579-a698-4866fb9b575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:53.399469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1224/2462] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:15:53.606677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993c288-dc90-4a39-8c10-39747c860f0f service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:15:53.608825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0993c288-dc90-4a39-8c10-39747c860f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:53.631137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993c288-dc90-4a39-8c10-39747c860f0f service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:15:53.642886 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:15:53.645087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:53.646615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:53.648399 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] PATH_INFO: `/v3/projects/3550bc0808da423d99355454e7043f57` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:53.652645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3550bc0808da423d99355454e7043f57)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:15:53.657071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:15:53.800015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3550bc0808da423d99355454e7043f57', 'request_id': 'req-49c32fb8-5bec-4814-b0b4-82b592836dca'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:53.808613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3550bc0808da423d99355454e7043f57', 'request_id': 'req-49c32fb8-5bec-4814-b0b4-82b592836dca'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:53.817490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3550bc0808da423d99355454e7043f57', 'request_id': 'req-49c32fb8-5bec-4814-b0b4-82b592836dca'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:53.860492 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] The token cache is being invalidate because project 3550bc0808da423d99355454e7043f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:15:53.861059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:53.863949 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-49c32fb8-5bec-4814-b0b4-82b592836dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:15:53.867365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1239/2463] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:15:53 2022] DELETE /identity/v3/projects/3550bc0808da423d99355454e7043f57 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:15:57.154495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570a085-faf8-4bf1-ac7c-2de018ee0ab2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:15:57.155423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570a085-faf8-4bf1-ac7c-2de018ee0ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:15:57.155731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570a085-faf8-4bf1-ac7c-2de018ee0ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:15:57.176088 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6570a085-faf8-4bf1-ac7c-2de018ee0ab2 None None] MFA Rules not processed for user `bf2b65c48bc141abbd3c56b791b213ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:15:57.177417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6570a085-faf8-4bf1-ac7c-2de018ee0ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:15:57.267972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1225/2464] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:15:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:00.482885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01c499-da5b-46ea-a5ca-77eb8385edde None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:00.484098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01c499-da5b-46ea-a5ca-77eb8385edde None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:00.485168 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01c499-da5b-46ea-a5ca-77eb8385edde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:00.575161 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-fd01c499-da5b-46ea-a5ca-77eb8385edde None None] MFA Rules not processed for user `74c2e8ea86364da787eeace1a2fe2ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:00.581305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fd01c499-da5b-46ea-a5ca-77eb8385edde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:00.767358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1240/2465] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:16:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:00.838118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570a085-faf8-4bf1-ac7c-2de018ee0ab2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:00.839853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6570a085-faf8-4bf1-ac7c-2de018ee0ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:00.863041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:00.995282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570a085-faf8-4bf1-ac7c-2de018ee0ab2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:01.004571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e0132-2abe-4cfa-9d19-91faf727d2fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:01.005559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0132-2abe-4cfa-9d19-91faf727d2fa service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:01.006002 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0132-2abe-4cfa-9d19-91faf727d2fa service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:01.006486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0132-2abe-4cfa-9d19-91faf727d2fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:01.009294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ae8e0132-2abe-4cfa-9d19-91faf727d2fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:01.089445 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e0132-2abe-4cfa-9d19-91faf727d2fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:01.091398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e0132-2abe-4cfa-9d19-91faf727d2fa service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:01.106972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1226/2466] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:10.757870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:11.098935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=53 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:17.156744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01c499-da5b-46ea-a5ca-77eb8385edde None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:17.158255 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fd01c499-da5b-46ea-a5ca-77eb8385edde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:17.225953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01c499-da5b-46ea-a5ca-77eb8385edde None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:17.230907 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef62ca-8628-4b7e-bb7f-3e5b3f0347b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:17.231636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef62ca-8628-4b7e-bb7f-3e5b3f0347b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:17.232015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef62ca-8628-4b7e-bb7f-3e5b3f0347b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:17.232304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef62ca-8628-4b7e-bb7f-3e5b3f0347b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:17.235356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1fef62ca-8628-4b7e-bb7f-3e5b3f0347b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:17.305378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef62ca-8628-4b7e-bb7f-3e5b3f0347b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:17.306981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef62ca-8628-4b7e-bb7f-3e5b3f0347b5 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:17.320088 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1241/2467] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:25.455887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d2b76-98dc-476c-9d36-fd108feca88b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:25.456391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d2b76-98dc-476c-9d36-fd108feca88b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:25.456499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d2b76-98dc-476c-9d36-fd108feca88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:25.474685 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-362d2b76-98dc-476c-9d36-fd108feca88b None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:25.475817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-362d2b76-98dc-476c-9d36-fd108feca88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:25.531846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1227/2468] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:16:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:25.579992 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef62ca-8628-4b7e-bb7f-3e5b3f0347b5 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:25.581453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1fef62ca-8628-4b7e-bb7f-3e5b3f0347b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:25.652838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef62ca-8628-4b7e-bb7f-3e5b3f0347b5 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:25.658699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d25650-57f4-41b0-b30a-1b6c9eef357b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:25.659361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d25650-57f4-41b0-b30a-1b6c9eef357b service swift] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:25.659652 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d25650-57f4-41b0-b30a-1b6c9eef357b service swift] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:25.659936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d25650-57f4-41b0-b30a-1b6c9eef357b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:25.668225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d25650-57f4-41b0-b30a-1b6c9eef357b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:25.669832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d25650-57f4-41b0-b30a-1b6c9eef357b service swift] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:25.678451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1242/2469] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:16:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:16:25.810436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b398-3a80-41a5-bc0e-523eb7248f12 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:25.811213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b398-3a80-41a5-bc0e-523eb7248f12 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:25.812200 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36b398-3a80-41a5-bc0e-523eb7248f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:25.844745 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9b36b398-3a80-41a5-bc0e-523eb7248f12 None None] MFA Rules not processed for user `5383a1d1bec34094a1889a86d87a88b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:25.846064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9b36b398-3a80-41a5-bc0e-523eb7248f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:25.854575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1228/2470] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:16:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:27.530778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d25650-57f4-41b0-b30a-1b6c9eef357b service swift] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:27.532769 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-27d25650-57f4-41b0-b30a-1b6c9eef357b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:27.590030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:27.624033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d25650-57f4-41b0-b30a-1b6c9eef357b service swift] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:27.630014 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa536a1-cd79-4982-9a33-584ab7d197ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:27.630782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa536a1-cd79-4982-9a33-584ab7d197ae service placement] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:27.631275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa536a1-cd79-4982-9a33-584ab7d197ae service placement] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:27.631628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa536a1-cd79-4982-9a33-584ab7d197ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:27.633669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-afa536a1-cd79-4982-9a33-584ab7d197ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:27.646954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa536a1-cd79-4982-9a33-584ab7d197ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:27.648666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa536a1-cd79-4982-9a33-584ab7d197ae service placement] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:27.662575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1243/2471] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:35.838201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=28 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:37.656192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=14 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:42.143406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a41cf-0326-4463-85c6-579287a3701f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:42.143880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a41cf-0326-4463-85c6-579287a3701f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:42.143984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a41cf-0326-4463-85c6-579287a3701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:42.162111 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-1e7a41cf-0326-4463-85c6-579287a3701f None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:42.163356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1e7a41cf-0326-4463-85c6-579287a3701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:42.171551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1229/2472] 10.222.0.66 () {58 vars in 967 bytes} [Mon Jul 11 14:16:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:42.183849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa536a1-cd79-4982-9a33-584ab7d197ae service placement] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:42.195172 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa536a1-cd79-4982-9a33-584ab7d197ae service placement] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:42.200443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1e265-e995-411e-8bbd-0f9fc5a9b4a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:42.201110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e265-e995-411e-8bbd-0f9fc5a9b4a7 service swift] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:42.201395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e265-e995-411e-8bbd-0f9fc5a9b4a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:42.201677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e265-e995-411e-8bbd-0f9fc5a9b4a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:42.210393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1e265-e995-411e-8bbd-0f9fc5a9b4a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:42.211989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1e265-e995-411e-8bbd-0f9fc5a9b4a7 service swift] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:42.221149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1244/2473] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:16:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:16:44.393945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a41cf-0326-4463-85c6-579287a3701f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:44.395461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1e7a41cf-0326-4463-85c6-579287a3701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:44.475598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a41cf-0326-4463-85c6-579287a3701f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:44.480180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b916182-b4ad-4911-9e3e-ba982b7f8074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:44.481059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b916182-b4ad-4911-9e3e-ba982b7f8074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:44.481343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b916182-b4ad-4911-9e3e-ba982b7f8074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:44.481768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b916182-b4ad-4911-9e3e-ba982b7f8074 admin admin] PATH_INFO: `/v3/users/bf2b65c48bc141abbd3c56b791b213ae` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:44.483094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b916182-b4ad-4911-9e3e-ba982b7f8074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2b65c48bc141abbd3c56b791b213ae)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:44.485053 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b916182-b4ad-4911-9e3e-ba982b7f8074 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:44.534408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3b916182-b4ad-4911-9e3e-ba982b7f8074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2b65c48bc141abbd3c56b791b213ae'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:44.535021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3b916182-b4ad-4911-9e3e-ba982b7f8074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2b65c48bc141abbd3c56b791b213ae'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:44.535634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3b916182-b4ad-4911-9e3e-ba982b7f8074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2b65c48bc141abbd3c56b791b213ae'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:44.542489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3b916182-b4ad-4911-9e3e-ba982b7f8074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2b65c48bc141abbd3c56b791b213ae'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:44.554960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3b916182-b4ad-4911-9e3e-ba982b7f8074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2b65c48bc141abbd3c56b791b213ae'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:44.568888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1230/2474] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:16:44 2022] DELETE /identity/v3/users/bf2b65c48bc141abbd3c56b791b213ae => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:44.749362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1e265-e995-411e-8bbd-0f9fc5a9b4a7 service swift] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:44.763721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1e265-e995-411e-8bbd-0f9fc5a9b4a7 service swift] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:44.847804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:44.848704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:44.848999 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:44.849363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] PATH_INFO: `/v3/projects/bdc81783ff1f4a47b617e77618303f94` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:44.851418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdc81783ff1f4a47b617e77618303f94)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:44.853357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:44.911741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdc81783ff1f4a47b617e77618303f94', 'request_id': 'req-7ffeadf5-3eee-49f9-97a9-153f308da195'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:44.919015 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdc81783ff1f4a47b617e77618303f94', 'request_id': 'req-7ffeadf5-3eee-49f9-97a9-153f308da195'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:44.925066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdc81783ff1f4a47b617e77618303f94', 'request_id': 'req-7ffeadf5-3eee-49f9-97a9-153f308da195'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:44.937954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] The token cache is being invalidate because project bdc81783ff1f4a47b617e77618303f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:16:44.938270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:44.938889 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-7ffeadf5-3eee-49f9-97a9-153f308da195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:16:44.940467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1245/2475] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:16:44 2022] DELETE /identity/v3/projects/bdc81783ff1f4a47b617e77618303f94 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:16:44.945433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108650c-2b6d-401f-ad5d-308dfb729dd4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:44.945727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108650c-2b6d-401f-ad5d-308dfb729dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:44.946009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108650c-2b6d-401f-ad5d-308dfb729dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:44.965244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8108650c-2b6d-401f-ad5d-308dfb729dd4 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:44.967122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8108650c-2b6d-401f-ad5d-308dfb729dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:45.027681 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1231/2476] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:45.036326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88a396-1595-4fe7-b26b-98cd50e43d22 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:45.036615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88a396-1595-4fe7-b26b-98cd50e43d22 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:45.036904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88a396-1595-4fe7-b26b-98cd50e43d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:45.055883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-6b88a396-1595-4fe7-b26b-98cd50e43d22 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:45.057095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6b88a396-1595-4fe7-b26b-98cd50e43d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:45.065441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1246/2477] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:45.069749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108650c-2b6d-401f-ad5d-308dfb729dd4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:45.081580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108650c-2b6d-401f-ad5d-308dfb729dd4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:45.086274 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7367b-a626-4638-9f84-2ca903d9ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:45.086944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7367b-a626-4638-9f84-2ca903d9ed1d admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:45.087230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7367b-a626-4638-9f84-2ca903d9ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:45.087509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7367b-a626-4638-9f84-2ca903d9ed1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:45.088362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7367b-a626-4638-9f84-2ca903d9ed1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:16:45.088681 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7367b-a626-4638-9f84-2ca903d9ed1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:45.090381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7367b-a626-4638-9f84-2ca903d9ed1d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:45.100198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:45.104397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1232/2478] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:16:45.109574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88a396-1595-4fe7-b26b-98cd50e43d22 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:45.119578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88a396-1595-4fe7-b26b-98cd50e43d22 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:45.124515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4129b7f-84da-4262-9393-9a2d73a66cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:45.125188 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129b7f-84da-4262-9393-9a2d73a66cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:45.125471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129b7f-84da-4262-9393-9a2d73a66cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:45.125755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129b7f-84da-4262-9393-9a2d73a66cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:45.126503 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4129b7f-84da-4262-9393-9a2d73a66cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:45.128707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4129b7f-84da-4262-9393-9a2d73a66cb1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:45.156966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1247/2479] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:16:45 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:16:45.161255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7367b-a626-4638-9f84-2ca903d9ed1d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:45.172347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7367b-a626-4638-9f84-2ca903d9ed1d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:45.235547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b248-063e-4415-a3b5-4f6643186997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:45.236233 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b248-063e-4415-a3b5-4f6643186997 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:45.236520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b248-063e-4415-a3b5-4f6643186997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:45.236798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912b248-063e-4415-a3b5-4f6643186997 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:45.237500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912b248-063e-4415-a3b5-4f6643186997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:45.239482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912b248-063e-4415-a3b5-4f6643186997 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:45.260342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1233/2480] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:16:45 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:16:45.265322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4129b7f-84da-4262-9393-9a2d73a66cb1 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:45.275778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4129b7f-84da-4262-9393-9a2d73a66cb1 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:45.280671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2074b2-1805-4c72-942c-ce45cc71f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:45.281298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2074b2-1805-4c72-942c-ce45cc71f734 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:45.281591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2074b2-1805-4c72-942c-ce45cc71f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:45.281874 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2074b2-1805-4c72-942c-ce45cc71f734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:45.282666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2074b2-1805-4c72-942c-ce45cc71f734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:45.284283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2074b2-1805-4c72-942c-ce45cc71f734 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:45.295948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1248/2481] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:16:45.300076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b248-063e-4415-a3b5-4f6643186997 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:45.311020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912b248-063e-4415-a3b5-4f6643186997 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:45.315752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f2026-e25f-4027-a274-c840c0427a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:45.316425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f2026-e25f-4027-a274-c840c0427a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:45.316704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f2026-e25f-4027-a274-c840c0427a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:45.316976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f2026-e25f-4027-a274-c840c0427a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:45.317706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f2026-e25f-4027-a274-c840c0427a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:45.319365 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f2026-e25f-4027-a274-c840c0427a49 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:45.331294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1234/2482] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:16:45.335732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2074b2-1805-4c72-942c-ce45cc71f734 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:45.346266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2074b2-1805-4c72-942c-ce45cc71f734 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:45.350921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295242c-a566-470e-b114-8e0944db5bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:45.351822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295242c-a566-470e-b114-8e0944db5bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:45.352113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295242c-a566-470e-b114-8e0944db5bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:45.352395 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295242c-a566-470e-b114-8e0944db5bf0 admin admin] PATH_INFO: `/v3/projects/414cbad62604448fbb29afd50269167a/users/17d64dba81c54543b66384220f3f0f75/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:45.367398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295242c-a566-470e-b114-8e0944db5bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414cbad62604448fbb29afd50269167a, user_id=17d64dba81c54543b66384220f3f0f75, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:45.370146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295242c-a566-470e-b114-8e0944db5bf0 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:45.384536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1249/2483] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:16:45 2022] PUT /identity/v3/projects/414cbad62604448fbb29afd50269167a/users/17d64dba81c54543b66384220f3f0f75/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:16:45.395383 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad551b-7289-4db4-ae9c-03bbd0253454 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:45.395880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad551b-7289-4db4-ae9c-03bbd0253454 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:45.395880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad551b-7289-4db4-ae9c-03bbd0253454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:45.424164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-34ad551b-7289-4db4-ae9c-03bbd0253454 None None] MFA Rules not processed for user `17d64dba81c54543b66384220f3f0f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:16:45.425419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-34ad551b-7289-4db4-ae9c-03bbd0253454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:45.491122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1235/2484] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:16:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:16:45.503683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295242c-a566-470e-b114-8e0944db5bf0 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:45.505493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0295242c-a566-470e-b114-8e0944db5bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:45.521588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:45.569539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295242c-a566-470e-b114-8e0944db5bf0 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:45.573752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9d4f-d35d-44b2-b857-b248db445103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:45.574474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9d4f-d35d-44b2-b857-b248db445103 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:45.574763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9d4f-d35d-44b2-b857-b248db445103 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:45.575046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9d4f-d35d-44b2-b857-b248db445103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:45.584632 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc9d4f-d35d-44b2-b857-b248db445103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:45.586116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc9d4f-d35d-44b2-b857-b248db445103 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:45.596829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1250/2485] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:46.242973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad551b-7289-4db4-ae9c-03bbd0253454 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:16:46.244440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-34ad551b-7289-4db4-ae9c-03bbd0253454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:46.304109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad551b-7289-4db4-ae9c-03bbd0253454 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:16:46.307676 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710c150-933a-4f50-9d7f-a623cc0e59a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:16:46.308368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710c150-933a-4f50-9d7f-a623cc0e59a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:16:46.308650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710c150-933a-4f50-9d7f-a623cc0e59a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:16:46.308927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710c150-933a-4f50-9d7f-a623cc0e59a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:16:46.311572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7710c150-933a-4f50-9d7f-a623cc0e59a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:16:46.334019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:46.380567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710c150-933a-4f50-9d7f-a623cc0e59a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:16:46.381944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710c150-933a-4f50-9d7f-a623cc0e59a3 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:16:46.391740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1236/2486] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:16:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:16:55.592025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=20 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:16:56.387563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=19 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:22.616771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9d4f-d35d-44b2-b857-b248db445103 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:22.680387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9d4f-d35d-44b2-b857-b248db445103 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:22.686279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:22.687742 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:22.688164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:22.688559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] PATH_INFO: `/v3/users/17d64dba81c54543b66384220f3f0f75` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:22.689782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d64dba81c54543b66384220f3f0f75)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:22.691771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:22.738726 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d64dba81c54543b66384220f3f0f75'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:22.739368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d64dba81c54543b66384220f3f0f75'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:22.739967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d64dba81c54543b66384220f3f0f75'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:22.747070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d64dba81c54543b66384220f3f0f75'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:22.754562 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d64dba81c54543b66384220f3f0f75'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:22.772052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1251/2487] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:17:22 2022] DELETE /identity/v3/users/17d64dba81c54543b66384220f3f0f75 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:22.777429 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027e82d-5156-4533-92cc-7628098e1094 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:22.777943 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027e82d-5156-4533-92cc-7628098e1094 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:22.778136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027e82d-5156-4533-92cc-7628098e1094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:22.796258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e027e82d-5156-4533-92cc-7628098e1094 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:22.797462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e027e82d-5156-4533-92cc-7628098e1094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:22.859678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1237/2488] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:22.869487 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:22.871116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:22.933125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72fa3c-96c9-4b98-a00d-c61f10c8fe65 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:22.936838 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36614a0c-6a41-4c7b-b297-c33550424536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:22.937491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36614a0c-6a41-4c7b-b297-c33550424536 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:22.937781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36614a0c-6a41-4c7b-b297-c33550424536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:22.938062 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36614a0c-6a41-4c7b-b297-c33550424536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:22.947099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36614a0c-6a41-4c7b-b297-c33550424536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:22.948778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36614a0c-6a41-4c7b-b297-c33550424536 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:22.958251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1252/2489] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:23.236948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027e82d-5156-4533-92cc-7628098e1094 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:23.238453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e027e82d-5156-4533-92cc-7628098e1094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:23.250678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027e82d-5156-4533-92cc-7628098e1094 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:23.260965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:23.262665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.262665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.262841 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] PATH_INFO: `/v3/projects/414cbad62604448fbb29afd50269167a` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.264094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=414cbad62604448fbb29afd50269167a)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:23.266090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:23.326615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414cbad62604448fbb29afd50269167a', 'request_id': 'req-9f0c7041-66a2-4e88-88d2-9ebb35042401'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:23.332174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414cbad62604448fbb29afd50269167a', 'request_id': 'req-9f0c7041-66a2-4e88-88d2-9ebb35042401'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:23.340623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414cbad62604448fbb29afd50269167a', 'request_id': 'req-9f0c7041-66a2-4e88-88d2-9ebb35042401'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:23.352000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] The token cache is being invalidate because project 414cbad62604448fbb29afd50269167a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:17:23.352284 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:23.352946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9f0c7041-66a2-4e88-88d2-9ebb35042401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:17:23.355482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1238/2490] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:17:23 2022] DELETE /identity/v3/projects/414cbad62604448fbb29afd50269167a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:23.360757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a487-0865-4c4c-8650-16fccdc6d77d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.361111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a487-0865-4c4c-8650-16fccdc6d77d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.361453 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745a487-0865-4c4c-8650-16fccdc6d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.380591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d745a487-0865-4c4c-8650-16fccdc6d77d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:23.381811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d745a487-0865-4c4c-8650-16fccdc6d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:23.399445 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:23.445717 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1253/2491] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:23.454828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ed6d-ca00-48ec-85dd-79113cc84734 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.455126 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ed6d-ca00-48ec-85dd-79113cc84734 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.455406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ed6d-ca00-48ec-85dd-79113cc84734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.474295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6458ed6d-ca00-48ec-85dd-79113cc84734 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:23.475501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6458ed6d-ca00-48ec-85dd-79113cc84734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:23.484376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1239/2492] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:23.488553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745a487-0865-4c4c-8650-16fccdc6d77d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:23.498924 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745a487-0865-4c4c-8650-16fccdc6d77d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:23.503929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9be4-2f31-4677-86da-f59276256516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:23.504597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9be4-2f31-4677-86da-f59276256516 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.504885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9be4-2f31-4677-86da-f59276256516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.505195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9be4-2f31-4677-86da-f59276256516 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.505928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b9be4-2f31-4677-86da-f59276256516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:17:23.506273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b9be4-2f31-4677-86da-f59276256516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:23.507891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b9be4-2f31-4677-86da-f59276256516 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:23.520060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1254/2493] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:17:23.524325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ed6d-ca00-48ec-85dd-79113cc84734 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:23.534448 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ed6d-ca00-48ec-85dd-79113cc84734 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:23.539150 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc75b6a-de05-408d-9d53-6da618a296b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:23.539800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc75b6a-de05-408d-9d53-6da618a296b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.540087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc75b6a-de05-408d-9d53-6da618a296b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.540370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc75b6a-de05-408d-9d53-6da618a296b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.541061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc75b6a-de05-408d-9d53-6da618a296b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:23.543759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc75b6a-de05-408d-9d53-6da618a296b2 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:23.568806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1240/2494] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:17:23 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:23.572915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9be4-2f31-4677-86da-f59276256516 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:23.583201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9be4-2f31-4677-86da-f59276256516 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:23.640974 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2649e06-9997-438b-969a-637c8ccb5e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:23.641716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2649e06-9997-438b-969a-637c8ccb5e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.642009 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2649e06-9997-438b-969a-637c8ccb5e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.642332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2649e06-9997-438b-969a-637c8ccb5e83 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.643051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2649e06-9997-438b-969a-637c8ccb5e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:23.645061 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2649e06-9997-438b-969a-637c8ccb5e83 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:23.665482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1255/2495] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:17:23 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:17:23.670139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc75b6a-de05-408d-9d53-6da618a296b2 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:23.680439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc75b6a-de05-408d-9d53-6da618a296b2 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:23.685405 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af535-5623-4c62-936b-9f705c57e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:23.686066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af535-5623-4c62-936b-9f705c57e8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.686395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af535-5623-4c62-936b-9f705c57e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.686672 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af535-5623-4c62-936b-9f705c57e8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.687392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659af535-5623-4c62-936b-9f705c57e8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:23.689021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659af535-5623-4c62-936b-9f705c57e8bb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:23.699472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1241/2496] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:23.703367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2649e06-9997-438b-969a-637c8ccb5e83 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:23.714090 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2649e06-9997-438b-969a-637c8ccb5e83 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:23.719619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4ead-adf4-49e6-9702-ff3c1f4c6088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:23.720318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4ead-adf4-49e6-9702-ff3c1f4c6088 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.720605 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4ead-adf4-49e6-9702-ff3c1f4c6088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.720884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4ead-adf4-49e6-9702-ff3c1f4c6088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.721648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b4ead-adf4-49e6-9702-ff3c1f4c6088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:23.723274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b4ead-adf4-49e6-9702-ff3c1f4c6088 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:23.734383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1256/2497] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:17:23.738574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af535-5623-4c62-936b-9f705c57e8bb admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:23.748638 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af535-5623-4c62-936b-9f705c57e8bb admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:23.753746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89312ea1-3188-4500-be6b-1931a2bd2941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:23.754655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89312ea1-3188-4500-be6b-1931a2bd2941 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.754938 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89312ea1-3188-4500-be6b-1931a2bd2941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.755257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89312ea1-3188-4500-be6b-1931a2bd2941 admin admin] PATH_INFO: `/v3/projects/85f9647b786a44948b284da50555b62f/users/ade7dda2cc0a49beb162804d36977079/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.769707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89312ea1-3188-4500-be6b-1931a2bd2941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f9647b786a44948b284da50555b62f, user_id=ade7dda2cc0a49beb162804d36977079, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:23.772471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89312ea1-3188-4500-be6b-1931a2bd2941 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:23.786083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1242/2498] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:17:23 2022] PUT /identity/v3/projects/85f9647b786a44948b284da50555b62f/users/ade7dda2cc0a49beb162804d36977079/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:17:23.791339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1013db8-7f25-4cd9-84ed-85a620ae6db1 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.792312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1013db8-7f25-4cd9-84ed-85a620ae6db1 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.792598 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1013db8-7f25-4cd9-84ed-85a620ae6db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.810344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e1013db8-7f25-4cd9-84ed-85a620ae6db1 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:23.811551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e1013db8-7f25-4cd9-84ed-85a620ae6db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:23.870813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1257/2499] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:23.880698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89312ea1-3188-4500-be6b-1931a2bd2941 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:23.882398 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-89312ea1-3188-4500-be6b-1931a2bd2941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:23.905969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:23.949645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89312ea1-3188-4500-be6b-1931a2bd2941 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:23.954099 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1f962-b13f-4c53-afb5-574a81a3e655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:23.954795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1f962-b13f-4c53-afb5-574a81a3e655 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:23.955084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1f962-b13f-4c53-afb5-574a81a3e655 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:23.955366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1f962-b13f-4c53-afb5-574a81a3e655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:23.966860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1f962-b13f-4c53-afb5-574a81a3e655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:23.968458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1f962-b13f-4c53-afb5-574a81a3e655 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:23.979692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1243/2500] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:24.740204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ce353-e0e8-4c9c-aba0-d4d4bc2852d6 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:24.740718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ce353-e0e8-4c9c-aba0-d4d4bc2852d6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:24.740839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ce353-e0e8-4c9c-aba0-d4d4bc2852d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:24.772745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f39ce353-e0e8-4c9c-aba0-d4d4bc2852d6 None None] MFA Rules not processed for user `ade7dda2cc0a49beb162804d36977079`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:24.773987 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f39ce353-e0e8-4c9c-aba0-d4d4bc2852d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:24.790997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:24.845042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1258/2501] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:17:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:24.857306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1f962-b13f-4c53-afb5-574a81a3e655 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:17:24.859111 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e4f1f962-b13f-4c53-afb5-574a81a3e655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:24.922785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1f962-b13f-4c53-afb5-574a81a3e655 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:17:24.926566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a71a8-2a71-43d8-b7b1-bf2f91c31c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:17:24.927227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a71a8-2a71-43d8-b7b1-bf2f91c31c7e service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:24.927514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a71a8-2a71-43d8-b7b1-bf2f91c31c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:24.927795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a71a8-2a71-43d8-b7b1-bf2f91c31c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:24.937284 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a71a8-2a71-43d8-b7b1-bf2f91c31c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:17:24.938789 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a71a8-2a71-43d8-b7b1-bf2f91c31c7e service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:17:24.949985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1244/2502] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:17:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:17:26.310443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5a3a-20ec-4b31-a214-0c1f65a83939 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:26.310965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5a3a-20ec-4b31-a214-0c1f65a83939 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:26.311073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5a3a-20ec-4b31-a214-0c1f65a83939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:26.328957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-644f5a3a-20ec-4b31-a214-0c1f65a83939 None None] MFA Rules not processed for user `ade7dda2cc0a49beb162804d36977079`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:26.330178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-644f5a3a-20ec-4b31-a214-0c1f65a83939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:26.337110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1259/2503] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:17:27.071928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb30211-abb3-43a5-bbf6-3cb76440fc46 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:17:27.072579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb30211-abb3-43a5-bbf6-3cb76440fc46 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:17:27.072579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb30211-abb3-43a5-bbf6-3cb76440fc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:17:27.092889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-feb30211-abb3-43a5-bbf6-3cb76440fc46 None None] MFA Rules not processed for user `39a5cea0a591453581a9d98ff796d973`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:17:27.094172 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-feb30211-abb3-43a5-bbf6-3cb76440fc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:17:27.156182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1245/2504] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:17:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:17:36.322993 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=22 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:17:37.148475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=68 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:16.071034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d9d83-0342-4a38-a267-41a8fe2b44d8 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:16.071581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d9d83-0342-4a38-a267-41a8fe2b44d8 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:16.071581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d9d83-0342-4a38-a267-41a8fe2b44d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:16.089376 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-383d9d83-0342-4a38-a267-41a8fe2b44d8 None None] MFA Rules not processed for user `79023e778baa45888e6ef870499e5ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:16.090629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-383d9d83-0342-4a38-a267-41a8fe2b44d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:16.147550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1260/2505] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:18:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:16.184369 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb30211-abb3-43a5-bbf6-3cb76440fc46 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:16.185878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-feb30211-abb3-43a5-bbf6-3cb76440fc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:16.242662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb30211-abb3-43a5-bbf6-3cb76440fc46 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:16.246558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc03f1-9c18-4cfb-aa47-1c86eb1f4d4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '690a93a4d6ed4666a607b05a8c2b6549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:16.247215 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc03f1-9c18-4cfb-aa47-1c86eb1f4d4f service glance] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:16.247763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc03f1-9c18-4cfb-aa47-1c86eb1f4d4f service glance] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:16.248060 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc03f1-9c18-4cfb-aa47-1c86eb1f4d4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:16.249927 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b2fc03f1-9c18-4cfb-aa47-1c86eb1f4d4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:16.320245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc03f1-9c18-4cfb-aa47-1c86eb1f4d4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:16.321626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fc03f1-9c18-4cfb-aa47-1c86eb1f4d4f service glance] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:16.333583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1246/2506] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:18.326555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d9d83-0342-4a38-a267-41a8fe2b44d8 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:18.336709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d9d83-0342-4a38-a267-41a8fe2b44d8 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:18.340873 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f07f6-5355-4dfd-80fe-a3201c4e1a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:18.341749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f07f6-5355-4dfd-80fe-a3201c4e1a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:18.342041 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f07f6-5355-4dfd-80fe-a3201c4e1a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:18.342349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f07f6-5355-4dfd-80fe-a3201c4e1a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:18.344204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-936f07f6-5355-4dfd-80fe-a3201c4e1a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:18.357876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f07f6-5355-4dfd-80fe-a3201c4e1a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:18.359358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f07f6-5355-4dfd-80fe-a3201c4e1a76 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:18.370528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1261/2507] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:22.589858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc03f1-9c18-4cfb-aa47-1c86eb1f4d4f service glance] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:22.600189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fc03f1-9c18-4cfb-aa47-1c86eb1f4d4f service glance] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:22.604066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40545bbc-a0df-4a74-af93-a7aaff2faeb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:22.604710 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40545bbc-a0df-4a74-af93-a7aaff2faeb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:22.604997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40545bbc-a0df-4a74-af93-a7aaff2faeb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:22.605276 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40545bbc-a0df-4a74-af93-a7aaff2faeb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:22.607120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-40545bbc-a0df-4a74-af93-a7aaff2faeb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:22.619607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40545bbc-a0df-4a74-af93-a7aaff2faeb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:22.621063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40545bbc-a0df-4a74-af93-a7aaff2faeb7 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:22.631546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1247/2508] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:28.365481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=31 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:30.995925 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f07f6-5355-4dfd-80fe-a3201c4e1a76 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:30.997373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-936f07f6-5355-4dfd-80fe-a3201c4e1a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:31.011905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f07f6-5355-4dfd-80fe-a3201c4e1a76 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:31.018443 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25175c6-74cf-4124-997a-afdc646ac3db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:31.019108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25175c6-74cf-4124-997a-afdc646ac3db service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:31.019397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25175c6-74cf-4124-997a-afdc646ac3db service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:31.019683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25175c6-74cf-4124-997a-afdc646ac3db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:31.021656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b25175c6-74cf-4124-997a-afdc646ac3db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:31.033285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25175c6-74cf-4124-997a-afdc646ac3db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:31.034923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25175c6-74cf-4124-997a-afdc646ac3db service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:31.044279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1262/2509] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:32.627177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=60 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:37.263552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ba7a-06fe-4f94-bae9-aee5b91b4033 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:37.265254 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ba7a-06fe-4f94-bae9-aee5b91b4033 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:37.265254 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240ba7a-06fe-4f94-bae9-aee5b91b4033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:37.284224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3240ba7a-06fe-4f94-bae9-aee5b91b4033 None None] MFA Rules not processed for user `ade7dda2cc0a49beb162804d36977079`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:37.285481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3240ba7a-06fe-4f94-bae9-aee5b91b4033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:37.293473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1248/2510] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:18:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:37.525500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25175c6-74cf-4124-997a-afdc646ac3db service nova] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:37.538859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25175c6-74cf-4124-997a-afdc646ac3db service nova] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:37.543233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8ba1d-cb73-4e80-8873-a6a107c8b6f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:37.544137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8ba1d-cb73-4e80-8873-a6a107c8b6f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:37.544627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8ba1d-cb73-4e80-8873-a6a107c8b6f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:37.545294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8ba1d-cb73-4e80-8873-a6a107c8b6f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:37.548673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fea8ba1d-cb73-4e80-8873-a6a107c8b6f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:37.561933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8ba1d-cb73-4e80-8873-a6a107c8b6f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:37.563419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea8ba1d-cb73-4e80-8873-a6a107c8b6f3 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:37.572537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1263/2511] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:38.407029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ba7a-06fe-4f94-bae9-aee5b91b4033 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:38.408501 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3240ba7a-06fe-4f94-bae9-aee5b91b4033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:38.530566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240ba7a-06fe-4f94-bae9-aee5b91b4033 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:38.536696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef887f90-f227-49d4-927a-ae912e5fd187 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:38.537450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887f90-f227-49d4-927a-ae912e5fd187 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:38.537740 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887f90-f227-49d4-927a-ae912e5fd187 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:38.538248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887f90-f227-49d4-927a-ae912e5fd187 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:38.540344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ef887f90-f227-49d4-927a-ae912e5fd187 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:38.552809 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef887f90-f227-49d4-927a-ae912e5fd187 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:38.554833 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef887f90-f227-49d4-927a-ae912e5fd187 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:38.566292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1249/2512] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:43.730399 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8ba1d-cb73-4e80-8873-a6a107c8b6f3 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:43.742116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8ba1d-cb73-4e80-8873-a6a107c8b6f3 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:43.746421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57057627-3595-48d0-8728-509cf0d5b3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:43.747422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57057627-3595-48d0-8728-509cf0d5b3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:43.747778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57057627-3595-48d0-8728-509cf0d5b3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:43.748145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57057627-3595-48d0-8728-509cf0d5b3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:43.752663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-57057627-3595-48d0-8728-509cf0d5b3d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:43.765363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57057627-3595-48d0-8728-509cf0d5b3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:43.767537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57057627-3595-48d0-8728-509cf0d5b3d4 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:43.780846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1264/2513] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:46.067128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef887f90-f227-49d4-927a-ae912e5fd187 service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:46.077498 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef887f90-f227-49d4-927a-ae912e5fd187 service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:46.081390 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960c25a-5c94-4b1f-931a-a4c4ed0234a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:46.082035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960c25a-5c94-4b1f-931a-a4c4ed0234a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:46.082367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960c25a-5c94-4b1f-931a-a4c4ed0234a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:46.082647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960c25a-5c94-4b1f-931a-a4c4ed0234a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:46.084440 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a960c25a-5c94-4b1f-931a-a4c4ed0234a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:46.097630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960c25a-5c94-4b1f-931a-a4c4ed0234a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:46.099453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960c25a-5c94-4b1f-931a-a4c4ed0234a9 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:46.109698 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1250/2514] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:50.431246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57057627-3595-48d0-8728-509cf0d5b3d4 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:50.445842 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57057627-3595-48d0-8728-509cf0d5b3d4 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:50.451704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7299f1-5a19-40b8-b088-33bef6305e7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:50.452740 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7299f1-5a19-40b8-b088-33bef6305e7a service placement] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:50.453182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7299f1-5a19-40b8-b088-33bef6305e7a service placement] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:50.453569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7299f1-5a19-40b8-b088-33bef6305e7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:50.455764 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ab7299f1-5a19-40b8-b088-33bef6305e7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:50.472574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7299f1-5a19-40b8-b088-33bef6305e7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:50.475549 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7299f1-5a19-40b8-b088-33bef6305e7a service placement] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:50.489702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960c25a-5c94-4b1f-931a-a4c4ed0234a9 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:50.490647 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1265/2515] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:50.491591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a960c25a-5c94-4b1f-931a-a4c4ed0234a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:50.510537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960c25a-5c94-4b1f-931a-a4c4ed0234a9 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:50.516094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1283883-a4cf-4c46-89d3-c0c81a5e05e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:50.516974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283883-a4cf-4c46-89d3-c0c81a5e05e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:50.517256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283883-a4cf-4c46-89d3-c0c81a5e05e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:50.517533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1283883-a4cf-4c46-89d3-c0c81a5e05e9 admin admin] PATH_INFO: `/v3/users/39a5cea0a591453581a9d98ff796d973` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:50.518772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1283883-a4cf-4c46-89d3-c0c81a5e05e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a5cea0a591453581a9d98ff796d973)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:50.520737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1283883-a4cf-4c46-89d3-c0c81a5e05e9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:50.569814 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d1283883-a4cf-4c46-89d3-c0c81a5e05e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a5cea0a591453581a9d98ff796d973'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:50.570477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d1283883-a4cf-4c46-89d3-c0c81a5e05e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a5cea0a591453581a9d98ff796d973'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:50.571149 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d1283883-a4cf-4c46-89d3-c0c81a5e05e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a5cea0a591453581a9d98ff796d973'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:50.579508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d1283883-a4cf-4c46-89d3-c0c81a5e05e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a5cea0a591453581a9d98ff796d973'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:50.592774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d1283883-a4cf-4c46-89d3-c0c81a5e05e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a5cea0a591453581a9d98ff796d973'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:50.606097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1251/2516] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:18:50 2022] DELETE /identity/v3/users/39a5cea0a591453581a9d98ff796d973 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:50.866039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7299f1-5a19-40b8-b088-33bef6305e7a service placement] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:50.878115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7299f1-5a19-40b8-b088-33bef6305e7a service placement] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:50.942778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:50.943679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:50.943969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:50.944250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] PATH_INFO: `/v3/projects/15d95b0cae244d99885be229335ea541` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:50.945444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d95b0cae244d99885be229335ea541)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:50.947486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:50.999230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d95b0cae244d99885be229335ea541', 'request_id': 'req-b9364a9e-88b2-4fda-96f2-2841a1f5a545'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:51.006709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d95b0cae244d99885be229335ea541', 'request_id': 'req-b9364a9e-88b2-4fda-96f2-2841a1f5a545'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:51.012610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d95b0cae244d99885be229335ea541', 'request_id': 'req-b9364a9e-88b2-4fda-96f2-2841a1f5a545'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:51.026027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] The token cache is being invalidate because project 15d95b0cae244d99885be229335ea541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:18:51.026357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:51.027007 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b9364a9e-88b2-4fda-96f2-2841a1f5a545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:18:51.028858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1266/2517] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:18:50 2022] DELETE /identity/v3/projects/15d95b0cae244d99885be229335ea541 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:18:51.034005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c7905-c4fc-4e7f-a394-255d2d4679ab None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:51.034347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c7905-c4fc-4e7f-a394-255d2d4679ab None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:51.034636 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c7905-c4fc-4e7f-a394-255d2d4679ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:51.054770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c11c7905-c4fc-4e7f-a394-255d2d4679ab None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:51.056008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c11c7905-c4fc-4e7f-a394-255d2d4679ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:51.103514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:51.129689 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1252/2518] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:51.137686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290cb50-e452-4697-b44d-2581e1c7ed37 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:51.138137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290cb50-e452-4697-b44d-2581e1c7ed37 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:51.138569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290cb50-e452-4697-b44d-2581e1c7ed37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:51.159196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-6290cb50-e452-4697-b44d-2581e1c7ed37 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:51.160419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6290cb50-e452-4697-b44d-2581e1c7ed37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:51.170231 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1267/2519] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:51.174593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c7905-c4fc-4e7f-a394-255d2d4679ab None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:51.186235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c7905-c4fc-4e7f-a394-255d2d4679ab None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:51.192105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5d58-62cc-4f22-b8a5-3fdc15b0f202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:51.192285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5d58-62cc-4f22-b8a5-3fdc15b0f202 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:51.192606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5d58-62cc-4f22-b8a5-3fdc15b0f202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:51.192920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a5d58-62cc-4f22-b8a5-3fdc15b0f202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:51.193694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a5d58-62cc-4f22-b8a5-3fdc15b0f202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:18:51.194038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a5d58-62cc-4f22-b8a5-3fdc15b0f202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:51.195838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a5d58-62cc-4f22-b8a5-3fdc15b0f202 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:51.209717 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1253/2520] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:18:51.214776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290cb50-e452-4697-b44d-2581e1c7ed37 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:51.224834 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290cb50-e452-4697-b44d-2581e1c7ed37 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:51.230370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f16f9-90e5-438b-aa5f-6c17fc3bb64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:51.231074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f16f9-90e5-438b-aa5f-6c17fc3bb64f admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:51.231368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f16f9-90e5-438b-aa5f-6c17fc3bb64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:51.231649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f16f9-90e5-438b-aa5f-6c17fc3bb64f admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:51.232885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f16f9-90e5-438b-aa5f-6c17fc3bb64f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:51.234831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f16f9-90e5-438b-aa5f-6c17fc3bb64f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:51.264869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1268/2521] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:18:51 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:51.266327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5d58-62cc-4f22-b8a5-3fdc15b0f202 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:51.277363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a5d58-62cc-4f22-b8a5-3fdc15b0f202 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:51.339172 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fdb4e-0c6c-4664-8dce-aa1cec61e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:51.339889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fdb4e-0c6c-4664-8dce-aa1cec61e3db admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:51.340195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fdb4e-0c6c-4664-8dce-aa1cec61e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:51.340475 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fdb4e-0c6c-4664-8dce-aa1cec61e3db admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:51.341349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fdb4e-0c6c-4664-8dce-aa1cec61e3db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:51.344612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fdb4e-0c6c-4664-8dce-aa1cec61e3db admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:51.368880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1254/2522] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:18:51 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:18:51.373022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f16f9-90e5-438b-aa5f-6c17fc3bb64f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:51.387540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f16f9-90e5-438b-aa5f-6c17fc3bb64f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:51.393346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73833d9-2369-4cd2-8e32-159bcff72be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:51.394060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73833d9-2369-4cd2-8e32-159bcff72be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:51.394494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73833d9-2369-4cd2-8e32-159bcff72be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:51.394679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73833d9-2369-4cd2-8e32-159bcff72be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:51.395442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73833d9-2369-4cd2-8e32-159bcff72be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:51.397054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73833d9-2369-4cd2-8e32-159bcff72be1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:51.399542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:51.411332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1269/2523] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:18:51.415316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fdb4e-0c6c-4664-8dce-aa1cec61e3db admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:51.426819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fdb4e-0c6c-4664-8dce-aa1cec61e3db admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:51.432074 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b07b30-bf00-4fe9-9cab-ddc70276e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:51.432867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07b30-bf00-4fe9-9cab-ddc70276e440 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:51.433035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07b30-bf00-4fe9-9cab-ddc70276e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:51.433309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07b30-bf00-4fe9-9cab-ddc70276e440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:51.434039 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b07b30-bf00-4fe9-9cab-ddc70276e440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:51.436138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b07b30-bf00-4fe9-9cab-ddc70276e440 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:51.447067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1255/2524] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:18:51.450956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73833d9-2369-4cd2-8e32-159bcff72be1 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:51.461763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73833d9-2369-4cd2-8e32-159bcff72be1 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:51.467336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e4464-6128-4b47-997d-907dd45f057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:51.468308 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e4464-6128-4b47-997d-907dd45f057f admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:51.468843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e4464-6128-4b47-997d-907dd45f057f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:51.469133 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e4464-6128-4b47-997d-907dd45f057f admin admin] PATH_INFO: `/v3/projects/4463cb0c8f5d473f955e0f08eb7b4e7f/users/999bc8975c43406c838e5c4bb2af1e53/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:51.485000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e4464-6128-4b47-997d-907dd45f057f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4463cb0c8f5d473f955e0f08eb7b4e7f, user_id=999bc8975c43406c838e5c4bb2af1e53, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:51.487735 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e4464-6128-4b47-997d-907dd45f057f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:51.502655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1270/2525] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:18:51 2022] PUT /identity/v3/projects/4463cb0c8f5d473f955e0f08eb7b4e7f/users/999bc8975c43406c838e5c4bb2af1e53/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:18:51.507673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f1368-3d2b-474d-bc32-9612c98ccc62 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:51.508137 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f1368-3d2b-474d-bc32-9612c98ccc62 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:51.508262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f1368-3d2b-474d-bc32-9612c98ccc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:51.526834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6d6f1368-3d2b-474d-bc32-9612c98ccc62 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:51.527984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6d6f1368-3d2b-474d-bc32-9612c98ccc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:51.590295 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1256/2526] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:51.600530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e4464-6128-4b47-997d-907dd45f057f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:51.602414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-237e4464-6128-4b47-997d-907dd45f057f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:51.661656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e4464-6128-4b47-997d-907dd45f057f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:51.665418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d25ee2-2721-4dcb-a363-a7e80e10475a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:51.666081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d25ee2-2721-4dcb-a363-a7e80e10475a service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:51.666416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d25ee2-2721-4dcb-a363-a7e80e10475a service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:51.666696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d25ee2-2721-4dcb-a363-a7e80e10475a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:51.677019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d25ee2-2721-4dcb-a363-a7e80e10475a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:51.678502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d25ee2-2721-4dcb-a363-a7e80e10475a service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:51.688438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1271/2527] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:55.988413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb564-798b-41fe-933e-53f8c84b29c0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:55.988889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb564-798b-41fe-933e-53f8c84b29c0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:55.989051 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabb564-798b-41fe-933e-53f8c84b29c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:56.017170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fcabb564-798b-41fe-933e-53f8c84b29c0 None None] MFA Rules not processed for user `999bc8975c43406c838e5c4bb2af1e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:56.018483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fcabb564-798b-41fe-933e-53f8c84b29c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:56.097611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:18:56.131470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1257/2528] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:18:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:56.146414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d25ee2-2721-4dcb-a363-a7e80e10475a service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:56.147887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b2d25ee2-2721-4dcb-a363-a7e80e10475a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:56.240811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d25ee2-2721-4dcb-a363-a7e80e10475a service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:56.247849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3e4ac-328e-476f-8b5a-77e4afb9f07e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:56.249050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3e4ac-328e-476f-8b5a-77e4afb9f07e service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:56.249478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3e4ac-328e-476f-8b5a-77e4afb9f07e service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:56.249847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3e4ac-328e-476f-8b5a-77e4afb9f07e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:56.259917 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3e4ac-328e-476f-8b5a-77e4afb9f07e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:56.261150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3e4ac-328e-476f-8b5a-77e4afb9f07e service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:56.274441 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1272/2529] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:56.823238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabb564-798b-41fe-933e-53f8c84b29c0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:56.824921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fcabb564-798b-41fe-933e-53f8c84b29c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:56.844807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabb564-798b-41fe-933e-53f8c84b29c0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:56.852583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532d8f0-7eff-478f-9ba1-7908b700aa45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:56.853372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d8f0-7eff-478f-9ba1-7908b700aa45 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:56.853735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d8f0-7eff-478f-9ba1-7908b700aa45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:56.854067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532d8f0-7eff-478f-9ba1-7908b700aa45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:56.858224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c532d8f0-7eff-478f-9ba1-7908b700aa45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:56.868441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532d8f0-7eff-478f-9ba1-7908b700aa45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:56.869888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532d8f0-7eff-478f-9ba1-7908b700aa45 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:56.884085 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1258/2530] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:57.025339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc309ae1-d72c-4a8e-bfd6-4eb890425059 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:57.025668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc309ae1-d72c-4a8e-bfd6-4eb890425059 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:57.025912 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc309ae1-d72c-4a8e-bfd6-4eb890425059 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:57.027696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1273/2531] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:18:57.033928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a0e20-df79-43f8-9490-efb8041a2afc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:57.034479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a0e20-df79-43f8-9490-efb8041a2afc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:57.034565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a0e20-df79-43f8-9490-efb8041a2afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:57.055715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fb6a0e20-df79-43f8-9490-efb8041a2afc None None] MFA Rules not processed for user `4426582f945e4c90bf8debd2ecbd9769`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:57.057170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fb6a0e20-df79-43f8-9490-efb8041a2afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:57.074934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1259/2532] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:18:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:18:57.088631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc309ae1-d72c-4a8e-bfd6-4eb890425059 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:57.106319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc309ae1-d72c-4a8e-bfd6-4eb890425059 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:57.111872 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72afe7-0fa4-44ed-b7dc-4aae07621507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:57.113816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72afe7-0fa4-44ed-b7dc-4aae07621507 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:57.114367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72afe7-0fa4-44ed-b7dc-4aae07621507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:57.115199 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72afe7-0fa4-44ed-b7dc-4aae07621507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:57.126294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72afe7-0fa4-44ed-b7dc-4aae07621507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:57.128457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72afe7-0fa4-44ed-b7dc-4aae07621507 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:57.140355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1274/2533] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:18:57.253768 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f6b02-38d8-4261-bb78-fe6d8f4fbc87 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:57.254056 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f6b02-38d8-4261-bb78-fe6d8f4fbc87 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:57.254709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f6b02-38d8-4261-bb78-fe6d8f4fbc87 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:57.256587 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1260/2534] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:18:57.263955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae593-da63-4040-87f6-960b6d830150 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:57.265300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae593-da63-4040-87f6-960b6d830150 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:57.265426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ae593-da63-4040-87f6-960b6d830150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:57.291584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-545ae593-da63-4040-87f6-960b6d830150 None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:57.292883 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-545ae593-da63-4040-87f6-960b6d830150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:57.312026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1275/2535] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:18:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:18:57.324007 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f6b02-38d8-4261-bb78-fe6d8f4fbc87 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:57.338119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f6b02-38d8-4261-bb78-fe6d8f4fbc87 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:57.343920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddd594-3d7a-48a3-b35e-cf547fd19019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:57.345227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd594-3d7a-48a3-b35e-cf547fd19019 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:57.345580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd594-3d7a-48a3-b35e-cf547fd19019 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:57.345935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd594-3d7a-48a3-b35e-cf547fd19019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:57.360139 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddd594-3d7a-48a3-b35e-cf547fd19019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:57.361825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ddd594-3d7a-48a3-b35e-cf547fd19019 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:57.376589 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1261/2536] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:18:58.044394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa622b-daa1-4821-bd78-0a0d38b75cba None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:58.045019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa622b-daa1-4821-bd78-0a0d38b75cba None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:58.045019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa622b-daa1-4821-bd78-0a0d38b75cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:58.062572 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-fbfa622b-daa1-4821-bd78-0a0d38b75cba None None] MFA Rules not processed for user `999bc8975c43406c838e5c4bb2af1e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:18:58.063773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fbfa622b-daa1-4821-bd78-0a0d38b75cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:58.070675 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1276/2537] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:18:59.127561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddd594-3d7a-48a3-b35e-cf547fd19019 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:18:59.129703 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e1ddd594-3d7a-48a3-b35e-cf547fd19019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:59.154643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddd594-3d7a-48a3-b35e-cf547fd19019 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:18:59.162057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d76ec-97f1-4013-b0b3-744a8eccbf1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:18:59.162816 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d76ec-97f1-4013-b0b3-744a8eccbf1e service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:18:59.163131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d76ec-97f1-4013-b0b3-744a8eccbf1e service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:18:59.163481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d76ec-97f1-4013-b0b3-744a8eccbf1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:18:59.165497 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a61d76ec-97f1-4013-b0b3-744a8eccbf1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:18:59.182724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d76ec-97f1-4013-b0b3-744a8eccbf1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:18:59.185678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d76ec-97f1-4013-b0b3-744a8eccbf1e service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:18:59.206321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1262/2538] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:18:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:19:00.696058 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa622b-daa1-4821-bd78-0a0d38b75cba None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:00.711175 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa622b-daa1-4821-bd78-0a0d38b75cba None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:00.724905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1aaff-f5ea-480f-9767-77c53e7a95e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:00.725869 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1aaff-f5ea-480f-9767-77c53e7a95e5 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:00.726377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1aaff-f5ea-480f-9767-77c53e7a95e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:00.726808 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1aaff-f5ea-480f-9767-77c53e7a95e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:00.731877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d3f1aaff-f5ea-480f-9767-77c53e7a95e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:00.756990 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1aaff-f5ea-480f-9767-77c53e7a95e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:00.760446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1aaff-f5ea-480f-9767-77c53e7a95e5 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:00.788070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1277/2539] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:19:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:19:02.483517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30cc39-8586-424d-ad3c-917c40019623 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:02.484038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30cc39-8586-424d-ad3c-917c40019623 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:02.484164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30cc39-8586-424d-ad3c-917c40019623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:02.503798 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fa30cc39-8586-424d-ad3c-917c40019623 None None] MFA Rules not processed for user `5383a1d1bec34094a1889a86d87a88b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:02.505059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fa30cc39-8586-424d-ad3c-917c40019623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:02.579546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1263/2540] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:19:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:10.773681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:12.573580 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=56 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:12.789023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1aaff-f5ea-480f-9767-77c53e7a95e5 service nova] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:12.808890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1aaff-f5ea-480f-9767-77c53e7a95e5 service nova] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:12.816327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f0405-c081-4798-871e-78890497961c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:12.817000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f0405-c081-4798-871e-78890497961c service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:12.817294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f0405-c081-4798-871e-78890497961c service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:12.817579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f0405-c081-4798-871e-78890497961c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:12.819648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c06f0405-c081-4798-871e-78890497961c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:12.835351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f0405-c081-4798-871e-78890497961c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:12.836971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f0405-c081-4798-871e-78890497961c service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:12.849800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1278/2541] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:19:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:19:22.846336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=6 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:44.750939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30cc39-8586-424d-ad3c-917c40019623 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:44.752435 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fa30cc39-8586-424d-ad3c-917c40019623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:44.809400 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f0405-c081-4798-871e-78890497961c service nova] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:44.811806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c06f0405-c081-4798-871e-78890497961c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:44.831031 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f0405-c081-4798-871e-78890497961c service nova] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:44.833512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30cc39-8586-424d-ad3c-917c40019623 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:44.835902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd325-0d23-4091-9b3c-1c883aa25017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:44.836790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd325-0d23-4091-9b3c-1c883aa25017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:44.837081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd325-0d23-4091-9b3c-1c883aa25017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:44.837398 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd325-0d23-4091-9b3c-1c883aa25017 admin admin] PATH_INFO: `/v3/users/ade7dda2cc0a49beb162804d36977079` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:44.838690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cd325-0d23-4091-9b3c-1c883aa25017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade7dda2cc0a49beb162804d36977079)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:44.839641 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee34dc5-fd33-4bed-8e26-67b1e3b3f2b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:44.840703 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34dc5-fd33-4bed-8e26-67b1e3b3f2b2 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:44.840822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cd325-0d23-4091-9b3c-1c883aa25017 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:44.841430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34dc5-fd33-4bed-8e26-67b1e3b3f2b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:44.841928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee34dc5-fd33-4bed-8e26-67b1e3b3f2b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:44.844483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bee34dc5-fd33-4bed-8e26-67b1e3b3f2b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:44.858473 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee34dc5-fd33-4bed-8e26-67b1e3b3f2b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:44.860105 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee34dc5-fd33-4bed-8e26-67b1e3b3f2b2 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:44.872686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1264/2542] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:19:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:19:44.892540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-150cd325-0d23-4091-9b3c-1c883aa25017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade7dda2cc0a49beb162804d36977079'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:44.893214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-150cd325-0d23-4091-9b3c-1c883aa25017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade7dda2cc0a49beb162804d36977079'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:44.893840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-150cd325-0d23-4091-9b3c-1c883aa25017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade7dda2cc0a49beb162804d36977079'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:44.902197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-150cd325-0d23-4091-9b3c-1c883aa25017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade7dda2cc0a49beb162804d36977079'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:44.911719 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-150cd325-0d23-4091-9b3c-1c883aa25017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade7dda2cc0a49beb162804d36977079'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:44.932357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1279/2543] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:19:44 2022] DELETE /identity/v3/users/ade7dda2cc0a49beb162804d36977079 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:19:45.114543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee34dc5-fd33-4bed-8e26-67b1e3b3f2b2 service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:45.127115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee34dc5-fd33-4bed-8e26-67b1e3b3f2b2 service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:45.189652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:45.190557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:45.190837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:45.191142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] PATH_INFO: `/v3/projects/85f9647b786a44948b284da50555b62f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:45.192349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f9647b786a44948b284da50555b62f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:45.194292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:45.271760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f9647b786a44948b284da50555b62f', 'request_id': 'req-fd603e96-3536-44d0-999a-288bff6c8d1e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:45.278114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f9647b786a44948b284da50555b62f', 'request_id': 'req-fd603e96-3536-44d0-999a-288bff6c8d1e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:45.286217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f9647b786a44948b284da50555b62f', 'request_id': 'req-fd603e96-3536-44d0-999a-288bff6c8d1e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:45.297822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] The token cache is being invalidate because project 85f9647b786a44948b284da50555b62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:19:45.298111 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:45.299033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fd603e96-3536-44d0-999a-288bff6c8d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:45.300596 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1265/2544] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:19:45 2022] DELETE /identity/v3/projects/85f9647b786a44948b284da50555b62f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:19:45.305724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2db09-6942-4298-9bd2-d80f5924d2b5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:45.306019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2db09-6942-4298-9bd2-d80f5924d2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:45.306334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2db09-6942-4298-9bd2-d80f5924d2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:45.325973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-aaf2db09-6942-4298-9bd2-d80f5924d2b5 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:45.327217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-aaf2db09-6942-4298-9bd2-d80f5924d2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:45.390355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1280/2545] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:45.398563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb0aa-97f4-400c-87ef-7e8b56c1305c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:45.398847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb0aa-97f4-400c-87ef-7e8b56c1305c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:45.399124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb0aa-97f4-400c-87ef-7e8b56c1305c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:45.417481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9b3fb0aa-97f4-400c-87ef-7e8b56c1305c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:45.419217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9b3fb0aa-97f4-400c-87ef-7e8b56c1305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:45.427177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1266/2546] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:45.431429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2db09-6942-4298-9bd2-d80f5924d2b5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:45.441841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2db09-6942-4298-9bd2-d80f5924d2b5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:45.446423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc300e7-ba59-4d1a-84e7-8316975d18aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:45.447082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc300e7-ba59-4d1a-84e7-8316975d18aa admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:45.447365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc300e7-ba59-4d1a-84e7-8316975d18aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:45.447640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc300e7-ba59-4d1a-84e7-8316975d18aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:45.448365 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc300e7-ba59-4d1a-84e7-8316975d18aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:19:45.448698 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc300e7-ba59-4d1a-84e7-8316975d18aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:45.450399 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc300e7-ba59-4d1a-84e7-8316975d18aa admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:45.470679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1281/2547] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:19:45.475324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb0aa-97f4-400c-87ef-7e8b56c1305c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:45.486484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb0aa-97f4-400c-87ef-7e8b56c1305c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:45.491805 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1c657-de5a-4607-bad5-f63f686462ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:45.492496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1c657-de5a-4607-bad5-f63f686462ef admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:45.492784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1c657-de5a-4607-bad5-f63f686462ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:45.493063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1c657-de5a-4607-bad5-f63f686462ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:45.493779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1c657-de5a-4607-bad5-f63f686462ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:45.495767 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1c657-de5a-4607-bad5-f63f686462ef admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:45.507426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:45.527025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1267/2548] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:19:45 2022] POST /identity/v3/projects => generated 395 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:19:45.531317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc300e7-ba59-4d1a-84e7-8316975d18aa admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:45.541716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc300e7-ba59-4d1a-84e7-8316975d18aa admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:45.610908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f5c6c-2667-4468-855d-501ad7183865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:45.611586 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f5c6c-2667-4468-855d-501ad7183865 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:45.611876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f5c6c-2667-4468-855d-501ad7183865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:45.612157 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f5c6c-2667-4468-855d-501ad7183865 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:45.612937 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f5c6c-2667-4468-855d-501ad7183865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:45.614926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f5c6c-2667-4468-855d-501ad7183865 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:45.622553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:45.638594 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1282/2549] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:19:45 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:19:45.643460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1c657-de5a-4607-bad5-f63f686462ef admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:45.653931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1c657-de5a-4607-bad5-f63f686462ef admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:45.658697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c427e-7eb7-425b-b14b-d2a301d70c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:45.659372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c427e-7eb7-425b-b14b-d2a301d70c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:45.659658 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c427e-7eb7-425b-b14b-d2a301d70c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:45.659932 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c427e-7eb7-425b-b14b-d2a301d70c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:45.660667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c427e-7eb7-425b-b14b-d2a301d70c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:45.662290 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c427e-7eb7-425b-b14b-d2a301d70c52 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:45.674389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1268/2550] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:19:45.678646 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f5c6c-2667-4468-855d-501ad7183865 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:45.689773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f5c6c-2667-4468-855d-501ad7183865 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:45.694598 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ac85a-226f-416a-8a19-461737bedfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:45.695276 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ac85a-226f-416a-8a19-461737bedfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:45.695564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ac85a-226f-416a-8a19-461737bedfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:45.695846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ac85a-226f-416a-8a19-461737bedfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:45.696584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ac85a-226f-416a-8a19-461737bedfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:45.698254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ac85a-226f-416a-8a19-461737bedfe2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:45.708783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1283/2551] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:19:45.712964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c427e-7eb7-425b-b14b-d2a301d70c52 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:45.724071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c427e-7eb7-425b-b14b-d2a301d70c52 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:45.728853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f845439-93bb-4427-be9c-4349cc6e3413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:45.729742 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845439-93bb-4427-be9c-4349cc6e3413 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:45.730022 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845439-93bb-4427-be9c-4349cc6e3413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:45.730951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845439-93bb-4427-be9c-4349cc6e3413 admin admin] PATH_INFO: `/v3/projects/81317a99635f4095b2d6a047cba3deb9/users/f6e2125583d74389b47483636ca7ebff/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:45.747515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f845439-93bb-4427-be9c-4349cc6e3413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81317a99635f4095b2d6a047cba3deb9, user_id=f6e2125583d74389b47483636ca7ebff, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:45.750719 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f845439-93bb-4427-be9c-4349cc6e3413 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:45.765599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1269/2552] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:19:45 2022] PUT /identity/v3/projects/81317a99635f4095b2d6a047cba3deb9/users/f6e2125583d74389b47483636ca7ebff/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:45.775612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e6570-cdf6-4c33-bbd2-5d6d7205883c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:45.775914 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e6570-cdf6-4c33-bbd2-5d6d7205883c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:45.776204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e6570-cdf6-4c33-bbd2-5d6d7205883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:45.805257 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5c0e6570-cdf6-4c33-bbd2-5d6d7205883c None None] MFA Rules not processed for user `f6e2125583d74389b47483636ca7ebff`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:45.806446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5c0e6570-cdf6-4c33-bbd2-5d6d7205883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:45.874944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1284/2553] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:19:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:45.886681 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f845439-93bb-4427-be9c-4349cc6e3413 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:45.888559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8f845439-93bb-4427-be9c-4349cc6e3413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:46.068732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f845439-93bb-4427-be9c-4349cc6e3413 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:46.072459 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161df57-50f9-493b-8bf5-f573647afb42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:46.073127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161df57-50f9-493b-8bf5-f573647afb42 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:46.073412 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161df57-50f9-493b-8bf5-f573647afb42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:46.073682 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161df57-50f9-493b-8bf5-f573647afb42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:46.083357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161df57-50f9-493b-8bf5-f573647afb42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:46.084805 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161df57-50f9-493b-8bf5-f573647afb42 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:46.094612 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1270/2554] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:19:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:19:54.160920 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e6570-cdf6-4c33-bbd2-5d6d7205883c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:54.227954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e6570-cdf6-4c33-bbd2-5d6d7205883c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:54.232653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:54.233658 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:54.233947 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:54.234256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] PATH_INFO: `/v3/users/f6e2125583d74389b47483636ca7ebff` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:54.235452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e2125583d74389b47483636ca7ebff)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:54.237425 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:54.295353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e2125583d74389b47483636ca7ebff'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:54.296055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e2125583d74389b47483636ca7ebff'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:54.296623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e2125583d74389b47483636ca7ebff'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:54.303460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e2125583d74389b47483636ca7ebff'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:54.311332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e2125583d74389b47483636ca7ebff'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:54.316759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:54.331362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1285/2555] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:19:54 2022] DELETE /identity/v3/users/f6e2125583d74389b47483636ca7ebff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:19:54.336008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcecdcb-2dfe-4854-800a-7ac7fdac4eb0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:54.336486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcecdcb-2dfe-4854-800a-7ac7fdac4eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:54.336620 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcecdcb-2dfe-4854-800a-7ac7fdac4eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:54.354323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-bdcecdcb-2dfe-4854-800a-7ac7fdac4eb0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:19:54.355576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bdcecdcb-2dfe-4854-800a-7ac7fdac4eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:54.424656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1271/2556] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:19:54.434627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:54.436399 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:54.505323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dc84f-e68d-4d55-9df3-a0c549acad0c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:54.509676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e85641-cdcf-457d-9351-e796e3864840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:54.510650 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e85641-cdcf-457d-9351-e796e3864840 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:54.511092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e85641-cdcf-457d-9351-e796e3864840 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:54.511542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e85641-cdcf-457d-9351-e796e3864840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:54.524293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e85641-cdcf-457d-9351-e796e3864840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:54.526008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e85641-cdcf-457d-9351-e796e3864840 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:54.540288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1286/2557] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:19:54.952635 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcecdcb-2dfe-4854-800a-7ac7fdac4eb0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:19:54.954233 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bdcecdcb-2dfe-4854-800a-7ac7fdac4eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:19:54.968347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcecdcb-2dfe-4854-800a-7ac7fdac4eb0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:19:54.979140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:19:54.979366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:19:54.979531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:19:54.979896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] PATH_INFO: `/v3/projects/81317a99635f4095b2d6a047cba3deb9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:19:54.981179 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81317a99635f4095b2d6a047cba3deb9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:19:54.983293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:19:55.036554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81317a99635f4095b2d6a047cba3deb9', 'request_id': 'req-a02bd8c9-5276-4124-b4ff-a42ff9b05915'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:55.041203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:19:55.045260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81317a99635f4095b2d6a047cba3deb9', 'request_id': 'req-a02bd8c9-5276-4124-b4ff-a42ff9b05915'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:55.054691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81317a99635f4095b2d6a047cba3deb9', 'request_id': 'req-a02bd8c9-5276-4124-b4ff-a42ff9b05915'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:55.067665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] The token cache is being invalidate because project 81317a99635f4095b2d6a047cba3deb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:19:55.067952 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:55.068700 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:19:55.070984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1272/2558] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:19:54 2022] DELETE /identity/v3/projects/81317a99635f4095b2d6a047cba3deb9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:20:02.221744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e85641-cdcf-457d-9351-e796e3864840 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:02.223185 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-20e85641-cdcf-457d-9351-e796e3864840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:02.234364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e85641-cdcf-457d-9351-e796e3864840 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:02.284321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f40b6-2dcf-488c-a0fd-f1dd7493f3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:02.284970 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f40b6-2dcf-488c-a0fd-f1dd7493f3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:02.285263 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f40b6-2dcf-488c-a0fd-f1dd7493f3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:02.285533 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f40b6-2dcf-488c-a0fd-f1dd7493f3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:02.287313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0a9f40b6-2dcf-488c-a0fd-f1dd7493f3c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:02.349456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f40b6-2dcf-488c-a0fd-f1dd7493f3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:02.350930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f40b6-2dcf-488c-a0fd-f1dd7493f3c0 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:02.361690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1287/2559] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:20:05.065173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=2,keystone:SELECT=5,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:05.554118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:05.555622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:05.569256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bd8c9-5276-4124-b4ff-a42ff9b05915 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:05.574639 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e79276-3ee9-46ee-b00f-2414def721c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:05.575546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e79276-3ee9-46ee-b00f-2414def721c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:05.575974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e79276-3ee9-46ee-b00f-2414def721c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:05.576286 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e79276-3ee9-46ee-b00f-2414def721c4 admin admin] PATH_INFO: `/v3/users/79023e778baa45888e6ef870499e5ad8` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:05.577640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e79276-3ee9-46ee-b00f-2414def721c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79023e778baa45888e6ef870499e5ad8)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:05.579665 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e79276-3ee9-46ee-b00f-2414def721c4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:05.641503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-75e79276-3ee9-46ee-b00f-2414def721c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79023e778baa45888e6ef870499e5ad8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:05.642291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-75e79276-3ee9-46ee-b00f-2414def721c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79023e778baa45888e6ef870499e5ad8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:05.642977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-75e79276-3ee9-46ee-b00f-2414def721c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79023e778baa45888e6ef870499e5ad8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:05.650593 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-75e79276-3ee9-46ee-b00f-2414def721c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79023e778baa45888e6ef870499e5ad8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:05.664603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-75e79276-3ee9-46ee-b00f-2414def721c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79023e778baa45888e6ef870499e5ad8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:05.679320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1273/2560] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:20:05 2022] DELETE /identity/v3/users/79023e778baa45888e6ef870499e5ad8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:20:05.876008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f40b6-2dcf-488c-a0fd-f1dd7493f3c0 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:05.890173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f40b6-2dcf-488c-a0fd-f1dd7493f3c0 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:05.931234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:05.952403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:05.953261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:05.953571 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:05.953876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] PATH_INFO: `/v3/projects/15ad9d19847049c18d3bdc9f6e6c5168` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:05.955155 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ad9d19847049c18d3bdc9f6e6c5168)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:05.957084 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:06.008776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ad9d19847049c18d3bdc9f6e6c5168', 'request_id': 'req-eecb5688-3bf6-474a-a354-261faa605ff2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:06.015151 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ad9d19847049c18d3bdc9f6e6c5168', 'request_id': 'req-eecb5688-3bf6-474a-a354-261faa605ff2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:06.020798 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ad9d19847049c18d3bdc9f6e6c5168', 'request_id': 'req-eecb5688-3bf6-474a-a354-261faa605ff2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:06.034565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] The token cache is being invalidate because project 15ad9d19847049c18d3bdc9f6e6c5168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:20:06.034856 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:06.035490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-eecb5688-3bf6-474a-a354-261faa605ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:20:06.037094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1288/2561] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:20:05 2022] DELETE /identity/v3/projects/15ad9d19847049c18d3bdc9f6e6c5168 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:20:06.043101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fed00-1913-4acb-81a2-36e3cfcf9e24 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:06.043319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fed00-1913-4acb-81a2-36e3cfcf9e24 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:06.043750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fed00-1913-4acb-81a2-36e3cfcf9e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:06.061724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b42fed00-1913-4acb-81a2-36e3cfcf9e24 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:06.062973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b42fed00-1913-4acb-81a2-36e3cfcf9e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:06.123619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1274/2562] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:06.131451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b224-1972-4e8c-a777-14d04e769357 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:06.131739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b224-1972-4e8c-a777-14d04e769357 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:06.132017 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9b224-1972-4e8c-a777-14d04e769357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:06.152421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-cfd9b224-1972-4e8c-a777-14d04e769357 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:06.153967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cfd9b224-1972-4e8c-a777-14d04e769357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:06.163069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1289/2563] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:06.168632 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fed00-1913-4acb-81a2-36e3cfcf9e24 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:06.179672 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fed00-1913-4acb-81a2-36e3cfcf9e24 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:06.186180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17af14-ecec-4b52-8afe-96a5f017d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:06.186973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17af14-ecec-4b52-8afe-96a5f017d28a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:06.187254 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17af14-ecec-4b52-8afe-96a5f017d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:06.187527 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17af14-ecec-4b52-8afe-96a5f017d28a admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:06.188285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17af14-ecec-4b52-8afe-96a5f017d28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:20:06.188591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17af14-ecec-4b52-8afe-96a5f017d28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:06.190249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17af14-ecec-4b52-8afe-96a5f017d28a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:06.205246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1275/2564] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:20:06.209617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9b224-1972-4e8c-a777-14d04e769357 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:06.219788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9b224-1972-4e8c-a777-14d04e769357 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:06.224613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7c77f-fe8b-4f3c-bcfb-d242b7034ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:06.225284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7c77f-fe8b-4f3c-bcfb-d242b7034ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:06.225573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7c77f-fe8b-4f3c-bcfb-d242b7034ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:06.225855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7c77f-fe8b-4f3c-bcfb-d242b7034ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:06.226601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7c77f-fe8b-4f3c-bcfb-d242b7034ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:06.228548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7c77f-fe8b-4f3c-bcfb-d242b7034ee3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:06.256439 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1290/2565] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:20:06 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:20:06.260694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17af14-ecec-4b52-8afe-96a5f017d28a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:06.271093 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17af14-ecec-4b52-8afe-96a5f017d28a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:06.327063 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85dddc-1c06-4f3d-8359-7887668609b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:06.327655 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85dddc-1c06-4f3d-8359-7887668609b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:06.327941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85dddc-1c06-4f3d-8359-7887668609b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:06.328216 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85dddc-1c06-4f3d-8359-7887668609b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:06.328923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85dddc-1c06-4f3d-8359-7887668609b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:06.330925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85dddc-1c06-4f3d-8359-7887668609b4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:06.337498 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:06.352602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1276/2566] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:20:06 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:20:06.356784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7c77f-fe8b-4f3c-bcfb-d242b7034ee3 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:06.371905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7c77f-fe8b-4f3c-bcfb-d242b7034ee3 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:06.377216 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba197b-8987-4485-a510-a6bda3afa83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:06.377943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba197b-8987-4485-a510-a6bda3afa83f admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:06.378283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba197b-8987-4485-a510-a6bda3afa83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:06.378573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba197b-8987-4485-a510-a6bda3afa83f admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:06.379320 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba197b-8987-4485-a510-a6bda3afa83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:06.380928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba197b-8987-4485-a510-a6bda3afa83f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:06.392162 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1291/2567] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:20:06.396305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85dddc-1c06-4f3d-8359-7887668609b4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:06.406849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85dddc-1c06-4f3d-8359-7887668609b4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:06.411465 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda508-efa3-4a19-b676-74707c2d8e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:06.412135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda508-efa3-4a19-b676-74707c2d8e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:06.412487 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda508-efa3-4a19-b676-74707c2d8e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:06.412696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda508-efa3-4a19-b676-74707c2d8e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:06.413416 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda508-efa3-4a19-b676-74707c2d8e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:06.415037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda508-efa3-4a19-b676-74707c2d8e76 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:06.425118 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1277/2568] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:20:06.429344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba197b-8987-4485-a510-a6bda3afa83f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:06.439414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba197b-8987-4485-a510-a6bda3afa83f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:06.444416 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa60cd8-1ecb-418b-8343-501338ef5274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:06.445344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa60cd8-1ecb-418b-8343-501338ef5274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:06.445640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa60cd8-1ecb-418b-8343-501338ef5274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:06.445921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa60cd8-1ecb-418b-8343-501338ef5274 admin admin] PATH_INFO: `/v3/projects/30c5e99c9761441fbad367a0bb8e1e66/users/5bbea49c1a55481c9995f04f2e9b8618/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:06.461362 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa60cd8-1ecb-418b-8343-501338ef5274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c5e99c9761441fbad367a0bb8e1e66, user_id=5bbea49c1a55481c9995f04f2e9b8618, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:06.464103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa60cd8-1ecb-418b-8343-501338ef5274 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:06.478900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1292/2569] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:20:06 2022] PUT /identity/v3/projects/30c5e99c9761441fbad367a0bb8e1e66/users/5bbea49c1a55481c9995f04f2e9b8618/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:20:06.484727 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b64a3d-19ac-4ece-9048-0ef8a3d5cbd6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:06.485025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b64a3d-19ac-4ece-9048-0ef8a3d5cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:06.485365 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b64a3d-19ac-4ece-9048-0ef8a3d5cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:06.503799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-26b64a3d-19ac-4ece-9048-0ef8a3d5cbd6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:06.505025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-26b64a3d-19ac-4ece-9048-0ef8a3d5cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:06.563707 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1278/2570] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:06.574117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa60cd8-1ecb-418b-8343-501338ef5274 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:06.575928 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1fa60cd8-1ecb-418b-8343-501338ef5274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:06.634905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa60cd8-1ecb-418b-8343-501338ef5274 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:06.639152 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70540a-4fcd-428b-8281-08a357ca99ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:06.639799 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70540a-4fcd-428b-8281-08a357ca99ed service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:06.640080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70540a-4fcd-428b-8281-08a357ca99ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:06.640355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70540a-4fcd-428b-8281-08a357ca99ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:06.649507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70540a-4fcd-428b-8281-08a357ca99ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:06.650970 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70540a-4fcd-428b-8281-08a357ca99ed service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:06.661619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1293/2571] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:20:10.900786 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc3ca9-a524-4811-abed-a859c4882fb8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:10.901340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc3ca9-a524-4811-abed-a859c4882fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:10.902041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc3ca9-a524-4811-abed-a859c4882fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:10.930140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-25cc3ca9-a524-4811-abed-a859c4882fb8 None None] MFA Rules not processed for user `5bbea49c1a55481c9995f04f2e9b8618`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:10.931469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-25cc3ca9-a524-4811-abed-a859c4882fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:11.014289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1279/2572] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:20:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:11.029739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70540a-4fcd-428b-8281-08a357ca99ed service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:11.032078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fa70540a-4fcd-428b-8281-08a357ca99ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:11.043472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:11.108630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70540a-4fcd-428b-8281-08a357ca99ed service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:11.114202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12e973-d910-4b51-b5b2-4aa7d63fb5e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:11.114859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12e973-d910-4b51-b5b2-4aa7d63fb5e9 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:11.115148 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12e973-d910-4b51-b5b2-4aa7d63fb5e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:11.115429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12e973-d910-4b51-b5b2-4aa7d63fb5e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:11.123765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12e973-d910-4b51-b5b2-4aa7d63fb5e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:11.125385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12e973-d910-4b51-b5b2-4aa7d63fb5e9 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:11.134513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1294/2573] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:20:12.441100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f245c-af70-499d-8860-3fca27efcb27 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:12.441992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f245c-af70-499d-8860-3fca27efcb27 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:12.442323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f245c-af70-499d-8860-3fca27efcb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:12.460271 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3f5f245c-af70-499d-8860-3fca27efcb27 None None] MFA Rules not processed for user `5bbea49c1a55481c9995f04f2e9b8618`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:12.461492 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3f5f245c-af70-499d-8860-3fca27efcb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:12.469380 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1280/2574] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:20:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:21.130381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=30 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:22.454945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:24.543824 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ea66-7bf6-43b1-bbb1-327df7a3eaf4 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:24.544327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ea66-7bf6-43b1-bbb1-327df7a3eaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:24.544465 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ea66-7bf6-43b1-bbb1-327df7a3eaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:24.562517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-10c6ea66-7bf6-43b1-bbb1-327df7a3eaf4 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:24.563763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-10c6ea66-7bf6-43b1-bbb1-327df7a3eaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:24.628201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1295/2575] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:20:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:24.678607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f245c-af70-499d-8860-3fca27efcb27 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:24.680722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3f5f245c-af70-499d-8860-3fca27efcb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:24.754273 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f245c-af70-499d-8860-3fca27efcb27 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:24.759441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361093f3-a782-49bc-a4e5-ab218548d67a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:24.761235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361093f3-a782-49bc-a4e5-ab218548d67a service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:24.761235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361093f3-a782-49bc-a4e5-ab218548d67a service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:24.761235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361093f3-a782-49bc-a4e5-ab218548d67a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:24.769846 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361093f3-a782-49bc-a4e5-ab218548d67a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:24.771662 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361093f3-a782-49bc-a4e5-ab218548d67a service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:24.779931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1281/2576] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:20:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:20:34.620470 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=25 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:34.776778 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=32 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:37.679217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161256-c0a2-4d05-84ab-86896f2cb407 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:37.679811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161256-c0a2-4d05-84ab-86896f2cb407 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:37.679939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161256-c0a2-4d05-84ab-86896f2cb407 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:37.682546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1296/2577] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:20:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:20:37.688711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5ef3d-90c4-4720-b52e-0a70dc2ac1a5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:37.689263 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5ef3d-90c4-4720-b52e-0a70dc2ac1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:37.689382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5ef3d-90c4-4720-b52e-0a70dc2ac1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:37.708888 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8ba5ef3d-90c4-4720-b52e-0a70dc2ac1a5 None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:37.710331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8ba5ef3d-90c4-4720-b52e-0a70dc2ac1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:37.722433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1282/2578] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:20:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:37.734326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161256-c0a2-4d05-84ab-86896f2cb407 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:37.736068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-27161256-c0a2-4d05-84ab-86896f2cb407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:37.798809 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161256-c0a2-4d05-84ab-86896f2cb407 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:37.802641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbdefe-57d2-47f1-86b7-f45616198516 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '690a93a4d6ed4666a607b05a8c2b6549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:37.803336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbdefe-57d2-47f1-86b7-f45616198516 service glance] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:37.803606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbdefe-57d2-47f1-86b7-f45616198516 service glance] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:37.803891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbdefe-57d2-47f1-86b7-f45616198516 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:37.815626 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbdefe-57d2-47f1-86b7-f45616198516 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:37.817063 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbdefe-57d2-47f1-86b7-f45616198516 service glance] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:37.828513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1297/2579] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:20:40.486218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86968e04-cfe7-476e-974f-dc5a37ef7310 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:40.486711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86968e04-cfe7-476e-974f-dc5a37ef7310 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:40.486825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86968e04-cfe7-476e-974f-dc5a37ef7310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:40.505089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-86968e04-cfe7-476e-974f-dc5a37ef7310 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:20:40.506402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-86968e04-cfe7-476e-974f-dc5a37ef7310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:40.514282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1283/2580] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:20:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:20:40.526361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbdefe-57d2-47f1-86b7-f45616198516 service glance] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:40.537524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbdefe-57d2-47f1-86b7-f45616198516 service glance] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:40.542455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613ec74-02e4-4e43-8ddb-399548f95ca7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:40.543094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ec74-02e4-4e43-8ddb-399548f95ca7 service swift] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:40.543378 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ec74-02e4-4e43-8ddb-399548f95ca7 service swift] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:40.543656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613ec74-02e4-4e43-8ddb-399548f95ca7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:40.551670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613ec74-02e4-4e43-8ddb-399548f95ca7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:40.553241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613ec74-02e4-4e43-8ddb-399548f95ca7 service swift] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:40.562114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1298/2581] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:20:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:20:50.432297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86968e04-cfe7-476e-974f-dc5a37ef7310 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:50.441730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86968e04-cfe7-476e-974f-dc5a37ef7310 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:50.445376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828e5be-ff64-4947-94b2-3b040d2d2cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:50.446021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828e5be-ff64-4947-94b2-3b040d2d2cdb service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:50.446357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828e5be-ff64-4947-94b2-3b040d2d2cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:50.446623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828e5be-ff64-4947-94b2-3b040d2d2cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:50.448411 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f828e5be-ff64-4947-94b2-3b040d2d2cdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:50.506903 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828e5be-ff64-4947-94b2-3b040d2d2cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:50.508263 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828e5be-ff64-4947-94b2-3b040d2d2cdb service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:50.517098 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1284/2582] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:20:50.558971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=32 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:20:56.878678 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613ec74-02e4-4e43-8ddb-399548f95ca7 service swift] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:20:56.880189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-2613ec74-02e4-4e43-8ddb-399548f95ca7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:56.894826 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613ec74-02e4-4e43-8ddb-399548f95ca7 service swift] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:20:56.899158 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214da78-6a50-48fa-890c-18f6e5668f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:20:56.900050 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214da78-6a50-48fa-890c-18f6e5668f95 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:20:56.900679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214da78-6a50-48fa-890c-18f6e5668f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:20:56.901062 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214da78-6a50-48fa-890c-18f6e5668f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:20:56.903712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5214da78-6a50-48fa-890c-18f6e5668f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:20:56.920334 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214da78-6a50-48fa-890c-18f6e5668f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:20:56.921828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214da78-6a50-48fa-890c-18f6e5668f95 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:20:56.933670 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1299/2583] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:00.513066 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=34 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:02.190783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056e614-fa1e-4038-8be4-d6edbcc71f16 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:02.191770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056e614-fa1e-4038-8be4-d6edbcc71f16 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:02.192202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056e614-fa1e-4038-8be4-d6edbcc71f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:02.221261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c056e614-fa1e-4038-8be4-d6edbcc71f16 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:02.222517 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c056e614-fa1e-4038-8be4-d6edbcc71f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:02.230431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1285/2584] 10.222.0.66 () {58 vars in 967 bytes} [Mon Jul 11 14:21:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:02.244879 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214da78-6a50-48fa-890c-18f6e5668f95 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:02.257452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214da78-6a50-48fa-890c-18f6e5668f95 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:02.263167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac49cb-6a4b-4618-9cf3-85f74fc8e9c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:02.263945 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac49cb-6a4b-4618-9cf3-85f74fc8e9c8 service swift] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:02.264340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac49cb-6a4b-4618-9cf3-85f74fc8e9c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:02.264728 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac49cb-6a4b-4618-9cf3-85f74fc8e9c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:02.274219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac49cb-6a4b-4618-9cf3-85f74fc8e9c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:02.275949 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac49cb-6a4b-4618-9cf3-85f74fc8e9c8 service swift] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:02.285737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1300/2585] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:21:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:21:03.559519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056e614-fa1e-4038-8be4-d6edbcc71f16 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:03.561065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c056e614-fa1e-4038-8be4-d6edbcc71f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:03.576120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056e614-fa1e-4038-8be4-d6edbcc71f16 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:03.580866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:03.581797 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:03.582029 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:03.582351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] PATH_INFO: `/v3/users/8455bd8a1dd841c6bac62b553f06e683` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:03.583598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8455bd8a1dd841c6bac62b553f06e683)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:03.585532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:03.634859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8455bd8a1dd841c6bac62b553f06e683'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:03.635513 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8455bd8a1dd841c6bac62b553f06e683'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:03.636121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8455bd8a1dd841c6bac62b553f06e683'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:03.642945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8455bd8a1dd841c6bac62b553f06e683'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:03.655098 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8455bd8a1dd841c6bac62b553f06e683'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:03.669706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1286/2586] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:21:03 2022] DELETE /identity/v3/users/8455bd8a1dd841c6bac62b553f06e683 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:03.861047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac49cb-6a4b-4618-9cf3-85f74fc8e9c8 service swift] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:03.873022 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac49cb-6a4b-4618-9cf3-85f74fc8e9c8 service swift] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:03.932654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:03.933724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:03.934174 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:03.934510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] PATH_INFO: `/v3/projects/5c6666e112684b9ea973be1c5833b0cb` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:03.936098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6666e112684b9ea973be1c5833b0cb)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:03.938053 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:03.986781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6666e112684b9ea973be1c5833b0cb', 'request_id': 'req-b6b189df-75f4-42c1-a567-838027a1b838'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:03.993102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6666e112684b9ea973be1c5833b0cb', 'request_id': 'req-b6b189df-75f4-42c1-a567-838027a1b838'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:03.999191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6666e112684b9ea973be1c5833b0cb', 'request_id': 'req-b6b189df-75f4-42c1-a567-838027a1b838'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.013673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] The token cache is being invalidate because project 5c6666e112684b9ea973be1c5833b0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:21:04.013963 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.014632 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.016310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1301/2587] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:21:03 2022] DELETE /identity/v3/projects/5c6666e112684b9ea973be1c5833b0cb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:04.020569 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:04.022001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:04.035609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b118d2-6806-4141-abab-4263532d8f12 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:04.093608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6eadba-3da0-4963-baa4-96e6753a4eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:04.094460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eadba-3da0-4963-baa4-96e6753a4eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:04.094829 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eadba-3da0-4963-baa4-96e6753a4eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:04.095028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6eadba-3da0-4963-baa4-96e6753a4eb6 admin admin] PATH_INFO: `/v3/users/22ad0fbc000e4a5d82dfee418ff9b82c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:04.096254 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eadba-3da0-4963-baa4-96e6753a4eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ad0fbc000e4a5d82dfee418ff9b82c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:04.098302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6eadba-3da0-4963-baa4-96e6753a4eb6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:04.147787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0e6eadba-3da0-4963-baa4-96e6753a4eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ad0fbc000e4a5d82dfee418ff9b82c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.148451 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0e6eadba-3da0-4963-baa4-96e6753a4eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ad0fbc000e4a5d82dfee418ff9b82c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.149064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0e6eadba-3da0-4963-baa4-96e6753a4eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ad0fbc000e4a5d82dfee418ff9b82c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.156664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0e6eadba-3da0-4963-baa4-96e6753a4eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ad0fbc000e4a5d82dfee418ff9b82c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.164599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:04.170121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0e6eadba-3da0-4963-baa4-96e6753a4eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ad0fbc000e4a5d82dfee418ff9b82c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.184599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1287/2588] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:21:04 2022] DELETE /identity/v3/users/22ad0fbc000e4a5d82dfee418ff9b82c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:04.369933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:04.371460 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:04.385811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b189df-75f4-42c1-a567-838027a1b838 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:04.444702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:04.446233 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:04.446519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:04.446798 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] PATH_INFO: `/v3/projects/3abb611c24c84eec9eeaf9fd480b785b` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:04.447989 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abb611c24c84eec9eeaf9fd480b785b)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:04.449900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:04.456248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:04.503382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abb611c24c84eec9eeaf9fd480b785b', 'request_id': 'req-cf0e7327-e291-4c35-9327-8a3896635115'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.511103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abb611c24c84eec9eeaf9fd480b785b', 'request_id': 'req-cf0e7327-e291-4c35-9327-8a3896635115'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.516840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abb611c24c84eec9eeaf9fd480b785b', 'request_id': 'req-cf0e7327-e291-4c35-9327-8a3896635115'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.531096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] The token cache is being invalidate because project 3abb611c24c84eec9eeaf9fd480b785b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:21:04.531394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.532526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:21:04.533806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1302/2589] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:21:04 2022] DELETE /identity/v3/projects/3abb611c24c84eec9eeaf9fd480b785b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:21:14.181160 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=4,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:14.527265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:19.506564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a8118-66fa-4850-9dd0-6716630e050d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:19.507094 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a8118-66fa-4850-9dd0-6716630e050d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:19.507202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a8118-66fa-4850-9dd0-6716630e050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:19.535020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-066a8118-66fa-4850-9dd0-6716630e050d None None] MFA Rules not processed for user `5bbea49c1a55481c9995f04f2e9b8618`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:19.536228 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-066a8118-66fa-4850-9dd0-6716630e050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:19.606839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1288/2590] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:21:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:24.292390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:24.293831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:24.375724 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e7327-e291-4c35-9327-8a3896635115 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:24.379341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb9fb5-3215-4368-a218-f459a2dc9039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:24.379996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb9fb5-3215-4368-a218-f459a2dc9039 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:24.380285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb9fb5-3215-4368-a218-f459a2dc9039 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:24.380566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb9fb5-3215-4368-a218-f459a2dc9039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:24.382422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-29eb9fb5-3215-4368-a218-f459a2dc9039 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:24.445057 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb9fb5-3215-4368-a218-f459a2dc9039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:24.447171 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb9fb5-3215-4368-a218-f459a2dc9039 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:24.456629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1303/2591] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:29.604784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=37 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:32.316673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82406-8cd1-4c15-844d-c836984d03d8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:32.317282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82406-8cd1-4c15-844d-c836984d03d8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:32.317282 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82406-8cd1-4c15-844d-c836984d03d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:32.335812 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-22b82406-8cd1-4c15-844d-c836984d03d8 None None] MFA Rules not processed for user `5383a1d1bec34094a1889a86d87a88b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:32.337120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-22b82406-8cd1-4c15-844d-c836984d03d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:32.344247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1289/2592] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:21:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:21:33.974559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb9fb5-3215-4368-a218-f459a2dc9039 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:33.976118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-29eb9fb5-3215-4368-a218-f459a2dc9039 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:34.079555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb9fb5-3215-4368-a218-f459a2dc9039 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:34.097905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d52d9-fc1d-4cf0-91eb-7ccde0167898 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:34.098589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d52d9-fc1d-4cf0-91eb-7ccde0167898 service placement] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:34.098887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d52d9-fc1d-4cf0-91eb-7ccde0167898 service placement] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:34.099238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d52d9-fc1d-4cf0-91eb-7ccde0167898 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:34.101190 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-517d52d9-fc1d-4cf0-91eb-7ccde0167898 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:34.119433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d52d9-fc1d-4cf0-91eb-7ccde0167898 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:34.120754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d52d9-fc1d-4cf0-91eb-7ccde0167898 service placement] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:34.128786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:34.136892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1304/2593] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:42.330430 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:44.132044 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:21:51.128581 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b82406-8cd1-4c15-844d-c836984d03d8 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:21:51.130375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-22b82406-8cd1-4c15-844d-c836984d03d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:51.219677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b82406-8cd1-4c15-844d-c836984d03d8 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:21:51.223308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f001a-96bd-402f-a002-6fe86c2d4f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:21:51.224131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f001a-96bd-402f-a002-6fe86c2d4f04 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:51.224454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f001a-96bd-402f-a002-6fe86c2d4f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:51.224761 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f001a-96bd-402f-a002-6fe86c2d4f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:51.228423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a98f001a-96bd-402f-a002-6fe86c2d4f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:51.297667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f001a-96bd-402f-a002-6fe86c2d4f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:21:51.299160 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f001a-96bd-402f-a002-6fe86c2d4f04 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:21:51.309538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1290/2594] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:21:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:21:52.596577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b45a-3056-4247-82bb-e3b975f63128 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:21:52.597140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b45a-3056-4247-82bb-e3b975f63128 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:21:52.597140 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725b45a-3056-4247-82bb-e3b975f63128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:21:52.615215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5725b45a-3056-4247-82bb-e3b975f63128 None None] MFA Rules not processed for user `999bc8975c43406c838e5c4bb2af1e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:21:52.616473 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5725b45a-3056-4247-82bb-e3b975f63128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:21:52.681881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1305/2595] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:21:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:01.305045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=59 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:02.673781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=25 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:22:24.867857 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48868f10-8a37-4c7b-ae03-1e56ecc470fb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:22:24.868419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48868f10-8a37-4c7b-ae03-1e56ecc470fb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:22:24.868419 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48868f10-8a37-4c7b-ae03-1e56ecc470fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:22:24.886875 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-48868f10-8a37-4c7b-ae03-1e56ecc470fb None None] MFA Rules not processed for user `5bbea49c1a55481c9995f04f2e9b8618`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:22:24.888019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-48868f10-8a37-4c7b-ae03-1e56ecc470fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:22:24.895302 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1291/2596] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:22:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:22:34.880791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:10.749851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953471e8-fe16-495f-9ebf-1f4b166c5561 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:10.750450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953471e8-fe16-495f-9ebf-1f4b166c5561 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:10.750450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953471e8-fe16-495f-9ebf-1f4b166c5561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:10.781962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-953471e8-fe16-495f-9ebf-1f4b166c5561 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:10.783211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-953471e8-fe16-495f-9ebf-1f4b166c5561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:10.845146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1306/2597] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:23:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:10.891690 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48868f10-8a37-4c7b-ae03-1e56ecc470fb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:10.893131 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-48868f10-8a37-4c7b-ae03-1e56ecc470fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:10.967624 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48868f10-8a37-4c7b-ae03-1e56ecc470fb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:10.972657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716a3d9-78ff-4e2a-846e-2067919e59cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:10.973308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716a3d9-78ff-4e2a-846e-2067919e59cb service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:10.973595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716a3d9-78ff-4e2a-846e-2067919e59cb service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:10.974196 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716a3d9-78ff-4e2a-846e-2067919e59cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:10.982377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716a3d9-78ff-4e2a-846e-2067919e59cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:10.983956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716a3d9-78ff-4e2a-846e-2067919e59cb service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:10.992508 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1292/2598] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:23:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:23:17.121503 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953471e8-fe16-495f-9ebf-1f4b166c5561 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:17.125210 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-953471e8-fe16-495f-9ebf-1f4b166c5561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:17.140754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953471e8-fe16-495f-9ebf-1f4b166c5561 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:17.144633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004ce83-111f-4adf-ba7b-3b9bcfa7468f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:17.145336 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ce83-111f-4adf-ba7b-3b9bcfa7468f service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:17.146143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ce83-111f-4adf-ba7b-3b9bcfa7468f service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:17.146458 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004ce83-111f-4adf-ba7b-3b9bcfa7468f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:17.148343 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0004ce83-111f-4adf-ba7b-3b9bcfa7468f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:17.275647 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004ce83-111f-4adf-ba7b-3b9bcfa7468f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:17.277936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004ce83-111f-4adf-ba7b-3b9bcfa7468f service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:17.302841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1307/2599] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:18.501594 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716a3d9-78ff-4e2a-846e-2067919e59cb service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:18.512931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716a3d9-78ff-4e2a-846e-2067919e59cb service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:18.516908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b80b5-ff62-4dcb-94d4-def2aaff55a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:18.517656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b80b5-ff62-4dcb-94d4-def2aaff55a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:18.518010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b80b5-ff62-4dcb-94d4-def2aaff55a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:18.518461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b80b5-ff62-4dcb-94d4-def2aaff55a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:18.521217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-049b80b5-ff62-4dcb-94d4-def2aaff55a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:18.535754 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b80b5-ff62-4dcb-94d4-def2aaff55a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:18.537728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b80b5-ff62-4dcb-94d4-def2aaff55a4 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:18.549673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1293/2600] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:24.405177 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e4a9c-341c-42ed-a8c6-63dea2d9a165 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.406285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e4a9c-341c-42ed-a8c6-63dea2d9a165 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.407039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e4a9c-341c-42ed-a8c6-63dea2d9a165 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.409002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1308/2601] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:23:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:23:24.417092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e19c64-3d0b-433e-b5b3-0e5687dc1265 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.417649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e19c64-3d0b-433e-b5b3-0e5687dc1265 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.417649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e19c64-3d0b-433e-b5b3-0e5687dc1265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.474026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-14e19c64-3d0b-433e-b5b3-0e5687dc1265 None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:24.475571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-14e19c64-3d0b-433e-b5b3-0e5687dc1265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:24.486212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1294/2602] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:23:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:24.502012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e4a9c-341c-42ed-a8c6-63dea2d9a165 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:24.504657 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-126e4a9c-341c-42ed-a8c6-63dea2d9a165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:24.572992 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e4a9c-341c-42ed-a8c6-63dea2d9a165 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:24.576679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a0912-66ab-4554-a14a-065796f2b240 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '690a93a4d6ed4666a607b05a8c2b6549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:24.577331 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a0912-66ab-4554-a14a-065796f2b240 service glance] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.577616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a0912-66ab-4554-a14a-065796f2b240 service glance] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.577892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a0912-66ab-4554-a14a-065796f2b240 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.588863 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a0912-66ab-4554-a14a-065796f2b240 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:24.590332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a0912-66ab-4554-a14a-065796f2b240 service glance] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:24.595275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:24.603540 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1309/2603] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:24.672891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce2731-9e0f-4525-ad8a-0d70cbac2d00 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.673310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce2731-9e0f-4525-ad8a-0d70cbac2d00 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.673661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce2731-9e0f-4525-ad8a-0d70cbac2d00 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.675225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1295/2604] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:23:24.680294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e3fec-b82d-473c-ba79-d9d2079734fb None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.680587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e3fec-b82d-473c-ba79-d9d2079734fb None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.681068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e3fec-b82d-473c-ba79-d9d2079734fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.719381 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ec9e3fec-b82d-473c-ba79-d9d2079734fb None None] MFA Rules not processed for user `4426582f945e4c90bf8debd2ecbd9769`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:24.720591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ec9e3fec-b82d-473c-ba79-d9d2079734fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:24.727849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1310/2605] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:23:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:24.739746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce2731-9e0f-4525-ad8a-0d70cbac2d00 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:24.750974 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce2731-9e0f-4525-ad8a-0d70cbac2d00 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:24.754567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b9762-d129-448a-8cf0-4c972698c400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:24.755208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b9762-d129-448a-8cf0-4c972698c400 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.755493 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b9762-d129-448a-8cf0-4c972698c400 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.755775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b9762-d129-448a-8cf0-4c972698c400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.763776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b9762-d129-448a-8cf0-4c972698c400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:24.765208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b9762-d129-448a-8cf0-4c972698c400 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:24.773793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1296/2606] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:24.856957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebedbb-5036-4390-ac5a-b71e4a3694c6 None None] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.857256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebedbb-5036-4390-ac5a-b71e4a3694c6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.857548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebedbb-5036-4390-ac5a-b71e4a3694c6 None None] PATH_INFO: `/` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.858982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1311/2607] 10.222.0.66 () {54 vars in 921 bytes} [Mon Jul 11 14:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 11 14:23:24.863855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04313941-6bb3-43fe-af9e-0f6b750b7ecb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.864154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04313941-6bb3-43fe-af9e-0f6b750b7ecb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.864437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04313941-6bb3-43fe-af9e-0f6b750b7ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.882871 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-04313941-6bb3-43fe-af9e-0f6b750b7ecb None None] MFA Rules not processed for user `38a31386700941c9b103720a64bac405`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:24.884012 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-04313941-6bb3-43fe-af9e-0f6b750b7ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:24.893408 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1297/2608] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Jul 11 14:23:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:24.904264 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebedbb-5036-4390-ac5a-b71e4a3694c6 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:24.916150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebedbb-5036-4390-ac5a-b71e4a3694c6 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:24.919772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4f8c8-0212-44ac-b5c4-b9c0692228eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:24.920422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f8c8-0212-44ac-b5c4-b9c0692228eb service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:24.920712 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f8c8-0212-44ac-b5c4-b9c0692228eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:24.920994 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4f8c8-0212-44ac-b5c4-b9c0692228eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:24.931584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4f8c8-0212-44ac-b5c4-b9c0692228eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:24.933029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4f8c8-0212-44ac-b5c4-b9c0692228eb service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:24.944309 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1312/2609] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:29.389957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef9308-4d36-4f8e-b84f-d7cdbfb48ef7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:29.390598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef9308-4d36-4f8e-b84f-d7cdbfb48ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:29.390598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef9308-4d36-4f8e-b84f-d7cdbfb48ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:29.408560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-12ef9308-4d36-4f8e-b84f-d7cdbfb48ef7 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:29.409878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-12ef9308-4d36-4f8e-b84f-d7cdbfb48ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:29.418252 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1298/2610] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:23:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:29.431248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4f8c8-0212-44ac-b5c4-b9c0692228eb service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:29.444059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4f8c8-0212-44ac-b5c4-b9c0692228eb service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:29.449117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23797fc7-48b6-45f5-9397-1b9a4fd196d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:29.449771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797fc7-48b6-45f5-9397-1b9a4fd196d9 service swift] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:29.450056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797fc7-48b6-45f5-9397-1b9a4fd196d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:29.450364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23797fc7-48b6-45f5-9397-1b9a4fd196d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:29.459797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23797fc7-48b6-45f5-9397-1b9a4fd196d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:29.461403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23797fc7-48b6-45f5-9397-1b9a4fd196d9 service swift] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:29.469816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1313/2611] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:23:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:23:39.403507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=63 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:39.466606 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=22 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:23:45.549065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef9308-4d36-4f8e-b84f-d7cdbfb48ef7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:45.568260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef9308-4d36-4f8e-b84f-d7cdbfb48ef7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:45.572174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbcb1c-61fd-4cd1-bdc3-f6567a9345b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:45.572852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbcb1c-61fd-4cd1-bdc3-f6567a9345b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:45.573140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbcb1c-61fd-4cd1-bdc3-f6567a9345b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:45.573443 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbcb1c-61fd-4cd1-bdc3-f6567a9345b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:45.577548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b2dbcb1c-61fd-4cd1-bdc3-f6567a9345b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:45.589694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbcb1c-61fd-4cd1-bdc3-f6567a9345b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:45.591584 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbcb1c-61fd-4cd1-bdc3-f6567a9345b4 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:45.601827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1299/2612] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:49.136872 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f162384-f915-4fa5-97b5-27d296bdb5f2 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:49.137382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f162384-f915-4fa5-97b5-27d296bdb5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:49.137659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f162384-f915-4fa5-97b5-27d296bdb5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:49.203921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-4f162384-f915-4fa5-97b5-27d296bdb5f2 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:49.205455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4f162384-f915-4fa5-97b5-27d296bdb5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:49.227994 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1314/2613] 10.222.0.66 () {58 vars in 967 bytes} [Mon Jul 11 14:23:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:23:49.241011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbcb1c-61fd-4cd1-bdc3-f6567a9345b4 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:49.266648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbcb1c-61fd-4cd1-bdc3-f6567a9345b4 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:49.274653 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012a41-c380-470f-bc47-40a569b33bfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:49.275363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012a41-c380-470f-bc47-40a569b33bfe service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:49.275647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012a41-c380-470f-bc47-40a569b33bfe service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:49.275924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012a41-c380-470f-bc47-40a569b33bfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:49.285361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012a41-c380-470f-bc47-40a569b33bfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:49.287231 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2012a41-c380-470f-bc47-40a569b33bfe service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:49.296948 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1300/2614] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:23:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:23:51.806068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f3f2c-bdb3-440c-87da-9655c9b3ab8d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:51.806769 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f3f2c-bdb3-440c-87da-9655c9b3ab8d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:51.807092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f3f2c-bdb3-440c-87da-9655c9b3ab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:51.828023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0c9f3f2c-bdb3-440c-87da-9655c9b3ab8d None None] MFA Rules not processed for user `5bbea49c1a55481c9995f04f2e9b8618`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:23:51.829897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0c9f3f2c-bdb3-440c-87da-9655c9b3ab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:51.838225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1315/2615] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:23:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:23:52.534776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012a41-c380-470f-bc47-40a569b33bfe service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:52.546818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012a41-c380-470f-bc47-40a569b33bfe service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:52.552372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a79a6-a37c-4e18-994f-51bfa4c4517a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:52.553107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a79a6-a37c-4e18-994f-51bfa4c4517a service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:52.553392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a79a6-a37c-4e18-994f-51bfa4c4517a service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:52.553667 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a79a6-a37c-4e18-994f-51bfa4c4517a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:52.555499 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fd6a79a6-a37c-4e18-994f-51bfa4c4517a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:52.568343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a79a6-a37c-4e18-994f-51bfa4c4517a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:52.569947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a79a6-a37c-4e18-994f-51bfa4c4517a service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:52.580549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1301/2616] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:23:53.403357 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f3f2c-bdb3-440c-87da-9655c9b3ab8d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:23:53.414212 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f3f2c-bdb3-440c-87da-9655c9b3ab8d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:23:53.417737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb8de-06d2-4696-a0d3-28c2b9da0973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:23:53.418422 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb8de-06d2-4696-a0d3-28c2b9da0973 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:23:53.418707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb8de-06d2-4696-a0d3-28c2b9da0973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:23:53.418986 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb8de-06d2-4696-a0d3-28c2b9da0973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:23:53.420786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-747bb8de-06d2-4696-a0d3-28c2b9da0973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:23:53.523018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bb8de-06d2-4696-a0d3-28c2b9da0973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:23:53.524469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bb8de-06d2-4696-a0d3-28c2b9da0973 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:23:53.543407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1316/2617] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:00.902409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a79a6-a37c-4e18-994f-51bfa4c4517a service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:00.904808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fd6a79a6-a37c-4e18-994f-51bfa4c4517a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:00.925258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a79a6-a37c-4e18-994f-51bfa4c4517a service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:00.933112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5843783-3d42-4d36-bea9-c578f75d7bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:00.934054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5843783-3d42-4d36-bea9-c578f75d7bb2 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:00.934454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5843783-3d42-4d36-bea9-c578f75d7bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:00.934825 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5843783-3d42-4d36-bea9-c578f75d7bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:00.939617 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b5843783-3d42-4d36-bea9-c578f75d7bb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:00.955856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5843783-3d42-4d36-bea9-c578f75d7bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:00.959248 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5843783-3d42-4d36-bea9-c578f75d7bb2 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:00.971652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1302/2618] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:01.017791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb8de-06d2-4696-a0d3-28c2b9da0973 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:01.020183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-747bb8de-06d2-4696-a0d3-28c2b9da0973 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:01.037822 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb8de-06d2-4696-a0d3-28c2b9da0973 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:01.042683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:01.044163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:01.044671 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:01.045176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] PATH_INFO: `/v3/users/5383a1d1bec34094a1889a86d87a88b5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:01.047275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5383a1d1bec34094a1889a86d87a88b5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:01.049942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:01.117447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5383a1d1bec34094a1889a86d87a88b5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.118469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5383a1d1bec34094a1889a86d87a88b5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.119138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5383a1d1bec34094a1889a86d87a88b5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.127349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5383a1d1bec34094a1889a86d87a88b5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.136294 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5383a1d1bec34094a1889a86d87a88b5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.150373 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:01.172812 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1317/2619] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:24:01 2022] DELETE /identity/v3/users/5383a1d1bec34094a1889a86d87a88b5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:01.365563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5843783-3d42-4d36-bea9-c578f75d7bb2 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:01.376551 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5843783-3d42-4d36-bea9-c578f75d7bb2 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:01.445391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:01.446278 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:01.446566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:01.446843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] PATH_INFO: `/v3/projects/8da67a5ec9194e7bad1eb52c45a584bf` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:01.448015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da67a5ec9194e7bad1eb52c45a584bf)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:01.449950 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:01.503656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da67a5ec9194e7bad1eb52c45a584bf', 'request_id': 'req-487d5eac-9aff-444f-b1fc-ae91e62ba491'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.509611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da67a5ec9194e7bad1eb52c45a584bf', 'request_id': 'req-487d5eac-9aff-444f-b1fc-ae91e62ba491'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.517299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da67a5ec9194e7bad1eb52c45a584bf', 'request_id': 'req-487d5eac-9aff-444f-b1fc-ae91e62ba491'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.529420 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] The token cache is being invalidate because project 8da67a5ec9194e7bad1eb52c45a584bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:24:01.529706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.530379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.531918 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1303/2620] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:24:01 2022] DELETE /identity/v3/projects/8da67a5ec9194e7bad1eb52c45a584bf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:01.536730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:01.538230 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:01.551654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67a47a-48da-4c96-9a35-afb5ce4cadae admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:01.611855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:01.613235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:01.613523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:01.613807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] PATH_INFO: `/v3/users/74c2e8ea86364da787eeace1a2fe2ae8` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:01.615070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c2e8ea86364da787eeace1a2fe2ae8)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:01.617104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:01.663840 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c2e8ea86364da787eeace1a2fe2ae8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.664490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c2e8ea86364da787eeace1a2fe2ae8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.665225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c2e8ea86364da787eeace1a2fe2ae8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.672042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c2e8ea86364da787eeace1a2fe2ae8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.680147 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c2e8ea86364da787eeace1a2fe2ae8'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:01.698867 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1318/2621] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:24:01 2022] DELETE /identity/v3/users/74c2e8ea86364da787eeace1a2fe2ae8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:01.883600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:01.885420 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:01.904061 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d5eac-9aff-444f-b1fc-ae91e62ba491 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:01.932714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:01.969626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:01.970523 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:01.970801 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:01.971073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] PATH_INFO: `/v3/projects/d13b29f30cc24092abf3980ba5e312f9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:01.972978 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d13b29f30cc24092abf3980ba5e312f9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:01.974937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:02.021127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd13b29f30cc24092abf3980ba5e312f9', 'request_id': 'req-b9e8df63-f604-43e0-97b4-0154de6a2891'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:02.026529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd13b29f30cc24092abf3980ba5e312f9', 'request_id': 'req-b9e8df63-f604-43e0-97b4-0154de6a2891'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:02.033853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd13b29f30cc24092abf3980ba5e312f9', 'request_id': 'req-b9e8df63-f604-43e0-97b4-0154de6a2891'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:02.045323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] The token cache is being invalidate because project d13b29f30cc24092abf3980ba5e312f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:24:02.045601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:02.046300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:02.047757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1304/2622] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:24:01 2022] DELETE /identity/v3/projects/d13b29f30cc24092abf3980ba5e312f9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:11.695124 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=56,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:12.042392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:24.420825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:24.422300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:24.499797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf92bd-9466-4d68-843c-d35b28736ddc admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:24.547625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb10819-949b-48c4-976d-a7bebfb3186f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:24.548287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10819-949b-48c4-976d-a7bebfb3186f service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:24.548576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10819-949b-48c4-976d-a7bebfb3186f service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:24.548857 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb10819-949b-48c4-976d-a7bebfb3186f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:24.550685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-eeb10819-949b-48c4-976d-a7bebfb3186f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:24.610128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb10819-949b-48c4-976d-a7bebfb3186f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:24.611633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb10819-949b-48c4-976d-a7bebfb3186f service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:24.621577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1319/2623] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:27.791409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:27.793536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:27.902574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8df63-f604-43e0-97b4-0154de6a2891 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:27.911052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cb809-0169-4091-a18a-ca2eead34bd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:27.911720 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cb809-0169-4091-a18a-ca2eead34bd6 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:27.912010 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cb809-0169-4091-a18a-ca2eead34bd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:27.912293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cb809-0169-4091-a18a-ca2eead34bd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:27.914750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8c3cb809-0169-4091-a18a-ca2eead34bd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:27.931291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cb809-0169-4091-a18a-ca2eead34bd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:27.933316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cb809-0169-4091-a18a-ca2eead34bd6 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:27.951097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1305/2624] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:31.564506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb10819-949b-48c4-976d-a7bebfb3186f service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:31.565955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-eeb10819-949b-48c4-976d-a7bebfb3186f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:31.626857 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb10819-949b-48c4-976d-a7bebfb3186f service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:31.631415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a9051-244d-49c5-9938-df555f4beec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:31.632095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a9051-244d-49c5-9938-df555f4beec6 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:31.632385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a9051-244d-49c5-9938-df555f4beec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:31.632672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a9051-244d-49c5-9938-df555f4beec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:31.634584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5c3a9051-244d-49c5-9938-df555f4beec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:31.639804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:31.699079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a9051-244d-49c5-9938-df555f4beec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:31.700570 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a9051-244d-49c5-9938-df555f4beec6 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:31.710420 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1320/2625] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:34.936399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cb809-0169-4091-a18a-ca2eead34bd6 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:34.937951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8c3cb809-0169-4091-a18a-ca2eead34bd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:34.953949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cb809-0169-4091-a18a-ca2eead34bd6 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:34.959697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36386a34-bb06-4e82-b882-f308e976eb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:34.960609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386a34-bb06-4e82-b882-f308e976eb0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:34.960899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386a34-bb06-4e82-b882-f308e976eb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:34.961176 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36386a34-bb06-4e82-b882-f308e976eb0e admin admin] PATH_INFO: `/v3/users/999bc8975c43406c838e5c4bb2af1e53` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:34.962437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36386a34-bb06-4e82-b882-f308e976eb0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=999bc8975c43406c838e5c4bb2af1e53)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:34.964366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36386a34-bb06-4e82-b882-f308e976eb0e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:35.012224 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-36386a34-bb06-4e82-b882-f308e976eb0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999bc8975c43406c838e5c4bb2af1e53'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:35.012897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-36386a34-bb06-4e82-b882-f308e976eb0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999bc8975c43406c838e5c4bb2af1e53'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:35.013506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-36386a34-bb06-4e82-b882-f308e976eb0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999bc8975c43406c838e5c4bb2af1e53'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:35.020730 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-36386a34-bb06-4e82-b882-f308e976eb0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999bc8975c43406c838e5c4bb2af1e53'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:35.032989 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-36386a34-bb06-4e82-b882-f308e976eb0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999bc8975c43406c838e5c4bb2af1e53'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:35.047073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1306/2626] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:24:34 2022] DELETE /identity/v3/users/999bc8975c43406c838e5c4bb2af1e53 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:35.233269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a9051-244d-49c5-9938-df555f4beec6 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:35.244074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a9051-244d-49c5-9938-df555f4beec6 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:35.304019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:35.304884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:35.305174 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:35.305457 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] PATH_INFO: `/v3/projects/4463cb0c8f5d473f955e0f08eb7b4e7f` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:35.306673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4463cb0c8f5d473f955e0f08eb7b4e7f)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:35.308588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:35.360628 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'request_id': 'req-384e92ec-8a50-4d68-a38a-be7fb1c40508'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:35.367637 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'request_id': 'req-384e92ec-8a50-4d68-a38a-be7fb1c40508'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:35.373150 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4463cb0c8f5d473f955e0f08eb7b4e7f', 'request_id': 'req-384e92ec-8a50-4d68-a38a-be7fb1c40508'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:35.386317 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] The token cache is being invalidate because project 4463cb0c8f5d473f955e0f08eb7b4e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:24:35.386623 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:35.387222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-384e92ec-8a50-4d68-a38a-be7fb1c40508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:35.388775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1321/2627] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:24:35 2022] DELETE /identity/v3/projects/4463cb0c8f5d473f955e0f08eb7b4e7f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:35.393759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dfb33-cd20-4e4e-ac15-d099107eca3e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:35.394630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dfb33-cd20-4e4e-ac15-d099107eca3e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:35.394913 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dfb33-cd20-4e4e-ac15-d099107eca3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:35.441376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-861dfb33-cd20-4e4e-ac15-d099107eca3e None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:35.442678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-861dfb33-cd20-4e4e-ac15-d099107eca3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:35.472771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:35.503905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1307/2628] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:35.511722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdcfb7-d694-4fe9-9709-95e76dc9fda4 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:35.512018 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdcfb7-d694-4fe9-9709-95e76dc9fda4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:35.512300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdcfb7-d694-4fe9-9709-95e76dc9fda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:35.531151 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-45cdcfb7-d694-4fe9-9709-95e76dc9fda4 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:35.532361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-45cdcfb7-d694-4fe9-9709-95e76dc9fda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:35.540393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1322/2629] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:35.544537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dfb33-cd20-4e4e-ac15-d099107eca3e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:35.554307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dfb33-cd20-4e4e-ac15-d099107eca3e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:35.559019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad286c-c403-4fe6-af53-b8d6d7a2f980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:35.559674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad286c-c403-4fe6-af53-b8d6d7a2f980 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:35.559963 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad286c-c403-4fe6-af53-b8d6d7a2f980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:35.560240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad286c-c403-4fe6-af53-b8d6d7a2f980 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:35.560972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad286c-c403-4fe6-af53-b8d6d7a2f980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:24:35.561281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad286c-c403-4fe6-af53-b8d6d7a2f980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:35.562920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad286c-c403-4fe6-af53-b8d6d7a2f980 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:35.575097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1308/2630] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:24:35.579436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdcfb7-d694-4fe9-9709-95e76dc9fda4 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:35.589884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdcfb7-d694-4fe9-9709-95e76dc9fda4 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:35.594752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355776b-59f8-454b-8f77-d2f12722706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:35.595418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355776b-59f8-454b-8f77-d2f12722706a admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:35.595708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355776b-59f8-454b-8f77-d2f12722706a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:35.595991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355776b-59f8-454b-8f77-d2f12722706a admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:35.596704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355776b-59f8-454b-8f77-d2f12722706a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:35.598743 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355776b-59f8-454b-8f77-d2f12722706a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:35.623353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:35.639904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1323/2631] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:24:35 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:24:35.643654 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad286c-c403-4fe6-af53-b8d6d7a2f980 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:35.654688 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad286c-c403-4fe6-af53-b8d6d7a2f980 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:35.711183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a8205-29b9-4705-9632-2afedca32a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:35.711862 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8205-29b9-4705-9632-2afedca32a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:35.712147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8205-29b9-4705-9632-2afedca32a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:35.712426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a8205-29b9-4705-9632-2afedca32a0a admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:35.713120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a8205-29b9-4705-9632-2afedca32a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:35.715081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a8205-29b9-4705-9632-2afedca32a0a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:35.734765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1309/2632] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:24:35 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:24:35.738946 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355776b-59f8-454b-8f77-d2f12722706a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:35.749745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355776b-59f8-454b-8f77-d2f12722706a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:35.755128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e6ef-c652-44f9-ae09-02dc1fc003c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:35.755809 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e6ef-c652-44f9-ae09-02dc1fc003c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:35.756089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e6ef-c652-44f9-ae09-02dc1fc003c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:35.756369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594e6ef-c652-44f9-ae09-02dc1fc003c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:35.757102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594e6ef-c652-44f9-ae09-02dc1fc003c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:35.758730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594e6ef-c652-44f9-ae09-02dc1fc003c3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:35.769702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1324/2633] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:24:35.773652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a8205-29b9-4705-9632-2afedca32a0a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:35.783545 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a8205-29b9-4705-9632-2afedca32a0a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:35.788417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a05d13-e542-49f9-9511-18e3389e57b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:35.789080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05d13-e542-49f9-9511-18e3389e57b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:35.789365 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05d13-e542-49f9-9511-18e3389e57b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:35.789679 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a05d13-e542-49f9-9511-18e3389e57b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:35.790405 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a05d13-e542-49f9-9511-18e3389e57b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:35.791998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a05d13-e542-49f9-9511-18e3389e57b0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:35.802555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1310/2634] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:24:35.806755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e6ef-c652-44f9-ae09-02dc1fc003c3 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:35.817353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594e6ef-c652-44f9-ae09-02dc1fc003c3 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:35.822005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46276b87-d51e-4c88-9abd-cc3cc8facb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:35.822921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276b87-d51e-4c88-9abd-cc3cc8facb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:35.823208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276b87-d51e-4c88-9abd-cc3cc8facb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:35.823486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46276b87-d51e-4c88-9abd-cc3cc8facb2f admin admin] PATH_INFO: `/v3/projects/f89040432f8449f6a655a4dce1768c99/users/cc24104a38544c899b7c460b9c96d7ef/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:35.839682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46276b87-d51e-4c88-9abd-cc3cc8facb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89040432f8449f6a655a4dce1768c99, user_id=cc24104a38544c899b7c460b9c96d7ef, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:35.842544 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46276b87-d51e-4c88-9abd-cc3cc8facb2f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:35.856702 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1325/2635] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:24:35 2022] PUT /identity/v3/projects/f89040432f8449f6a655a4dce1768c99/users/cc24104a38544c899b7c460b9c96d7ef/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:35.867738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881430-e45d-474c-8832-fc461f94130a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:35.868031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881430-e45d-474c-8832-fc461f94130a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:35.868312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad881430-e45d-474c-8832-fc461f94130a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:35.897186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ad881430-e45d-474c-8832-fc461f94130a None None] MFA Rules not processed for user `cc24104a38544c899b7c460b9c96d7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:35.898460 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ad881430-e45d-474c-8832-fc461f94130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:35.969050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1311/2636] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:24:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:35.981095 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46276b87-d51e-4c88-9abd-cc3cc8facb2f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:35.982839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-46276b87-d51e-4c88-9abd-cc3cc8facb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:36.055973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46276b87-d51e-4c88-9abd-cc3cc8facb2f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:36.061428 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733334e8-4a2d-45ca-addf-32176cb98ffe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:36.062146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733334e8-4a2d-45ca-addf-32176cb98ffe service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:36.062455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733334e8-4a2d-45ca-addf-32176cb98ffe service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:36.062730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733334e8-4a2d-45ca-addf-32176cb98ffe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:36.070915 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733334e8-4a2d-45ca-addf-32176cb98ffe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:36.072521 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733334e8-4a2d-45ca-addf-32176cb98ffe service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:36.081229 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1326/2637] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:36.311319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad881430-e45d-474c-8832-fc461f94130a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:36.345336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:36.376243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad881430-e45d-474c-8832-fc461f94130a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:36.381328 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:36.382236 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:36.382528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:36.382807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] PATH_INFO: `/v3/users/cc24104a38544c899b7c460b9c96d7ef` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:36.384004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc24104a38544c899b7c460b9c96d7ef)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:36.385941 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:36.434081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc24104a38544c899b7c460b9c96d7ef'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:36.434691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc24104a38544c899b7c460b9c96d7ef'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:36.435305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc24104a38544c899b7c460b9c96d7ef'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:36.442852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc24104a38544c899b7c460b9c96d7ef'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:36.455300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc24104a38544c899b7c460b9c96d7ef'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:36.468132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1312/2638] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:24:36 2022] DELETE /identity/v3/users/cc24104a38544c899b7c460b9c96d7ef => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:36.472845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d774b06-cc22-437e-a08f-7d0b02b3f94d None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:36.473332 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d774b06-cc22-437e-a08f-7d0b02b3f94d None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:36.473433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d774b06-cc22-437e-a08f-7d0b02b3f94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:36.489994 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-0d774b06-cc22-437e-a08f-7d0b02b3f94d None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:36.491345 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0d774b06-cc22-437e-a08f-7d0b02b3f94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:36.552967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1327/2639] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:36.562837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:36.564241 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:36.622640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65041ba9-7ad6-4f1b-8836-aede7b332153 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:36.626387 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b35d1-09c3-43c6-a99e-e9fe109874c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:36.627182 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b35d1-09c3-43c6-a99e-e9fe109874c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:36.627377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b35d1-09c3-43c6-a99e-e9fe109874c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:36.627614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b35d1-09c3-43c6-a99e-e9fe109874c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:36.640476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b35d1-09c3-43c6-a99e-e9fe109874c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:36.641959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b35d1-09c3-43c6-a99e-e9fe109874c5 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:36.652842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1313/2640] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:36.922480 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d774b06-cc22-437e-a08f-7d0b02b3f94d None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:36.923908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0d774b06-cc22-437e-a08f-7d0b02b3f94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:36.937304 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d774b06-cc22-437e-a08f-7d0b02b3f94d None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:36.942801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:36.943674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:36.943958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:36.944238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] PATH_INFO: `/v3/projects/f89040432f8449f6a655a4dce1768c99` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:36.945605 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89040432f8449f6a655a4dce1768c99)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:36.948106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:36.990353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:INSERT=2,keystone:SELECT=95,keystone:DELETE=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:36.998175 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89040432f8449f6a655a4dce1768c99', 'request_id': 'req-ede63249-c023-49af-bf21-297bafec5470'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:37.005490 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89040432f8449f6a655a4dce1768c99', 'request_id': 'req-ede63249-c023-49af-bf21-297bafec5470'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:37.011080 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89040432f8449f6a655a4dce1768c99', 'request_id': 'req-ede63249-c023-49af-bf21-297bafec5470'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:37.023976 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] The token cache is being invalidate because project f89040432f8449f6a655a4dce1768c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:24:37.024268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:37.024901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-ede63249-c023-49af-bf21-297bafec5470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:24:37.026516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1328/2641] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:24:36 2022] DELETE /identity/v3/projects/f89040432f8449f6a655a4dce1768c99 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:37.031437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163dd80-ef6e-4b81-b45f-1298fc314a30 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.031896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163dd80-ef6e-4b81-b45f-1298fc314a30 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.032012 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163dd80-ef6e-4b81-b45f-1298fc314a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.049539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a163dd80-ef6e-4b81-b45f-1298fc314a30 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:37.050827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a163dd80-ef6e-4b81-b45f-1298fc314a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:37.097227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:37.110998 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1314/2642] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:37.119287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a39f9-4583-46b2-8967-bc888e7bc7c5 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.119588 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a39f9-4583-46b2-8967-bc888e7bc7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.119875 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a39f9-4583-46b2-8967-bc888e7bc7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.138704 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-301a39f9-4583-46b2-8967-bc888e7bc7c5 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:37.139924 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-301a39f9-4583-46b2-8967-bc888e7bc7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:37.148426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1329/2643] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:37.152557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163dd80-ef6e-4b81-b45f-1298fc314a30 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.162278 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163dd80-ef6e-4b81-b45f-1298fc314a30 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.167004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62232328-30b0-49e2-97ba-d68a0dc8c26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.167695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62232328-30b0-49e2-97ba-d68a0dc8c26a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.167981 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62232328-30b0-49e2-97ba-d68a0dc8c26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.168260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62232328-30b0-49e2-97ba-d68a0dc8c26a admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.168993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62232328-30b0-49e2-97ba-d68a0dc8c26a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:24:37.169300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62232328-30b0-49e2-97ba-d68a0dc8c26a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.170959 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62232328-30b0-49e2-97ba-d68a0dc8c26a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.182782 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1315/2644] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:24:37.187040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a39f9-4583-46b2-8967-bc888e7bc7c5 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.196807 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a39f9-4583-46b2-8967-bc888e7bc7c5 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.201639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184871-f92b-4d04-8029-1766054b4505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.202333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184871-f92b-4d04-8029-1766054b4505 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.202620 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184871-f92b-4d04-8029-1766054b4505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.202895 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184871-f92b-4d04-8029-1766054b4505 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.203599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01184871-f92b-4d04-8029-1766054b4505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.205491 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01184871-f92b-4d04-8029-1766054b4505 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.232459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1330/2645] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:24:37 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:24:37.236522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62232328-30b0-49e2-97ba-d68a0dc8c26a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.247057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62232328-30b0-49e2-97ba-d68a0dc8c26a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.304830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afad8f-b0a9-4726-bf4e-23ea671660e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.305423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afad8f-b0a9-4726-bf4e-23ea671660e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.305711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afad8f-b0a9-4726-bf4e-23ea671660e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.305991 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afad8f-b0a9-4726-bf4e-23ea671660e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.306723 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afad8f-b0a9-4726-bf4e-23ea671660e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.308640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afad8f-b0a9-4726-bf4e-23ea671660e8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.329083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1316/2646] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:24:37 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:24:37.333346 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184871-f92b-4d04-8029-1766054b4505 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.343942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184871-f92b-4d04-8029-1766054b4505 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.348716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ec8ed-de74-4fa7-bce8-b4e3fbb9df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.349392 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ec8ed-de74-4fa7-bce8-b4e3fbb9df2a admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.349683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ec8ed-de74-4fa7-bce8-b4e3fbb9df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.349967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ec8ed-de74-4fa7-bce8-b4e3fbb9df2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.350747 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ec8ed-de74-4fa7-bce8-b4e3fbb9df2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.352538 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ec8ed-de74-4fa7-bce8-b4e3fbb9df2a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.363895 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1331/2647] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:24:37.368121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afad8f-b0a9-4726-bf4e-23ea671660e8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.378047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afad8f-b0a9-4726-bf4e-23ea671660e8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.383287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f6680-43c2-41bd-a2b6-5ebca9916e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.383942 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f6680-43c2-41bd-a2b6-5ebca9916e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.384223 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f6680-43c2-41bd-a2b6-5ebca9916e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.384496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f6680-43c2-41bd-a2b6-5ebca9916e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.385211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f6680-43c2-41bd-a2b6-5ebca9916e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.386836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f6680-43c2-41bd-a2b6-5ebca9916e3a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.396774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1317/2648] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:24:37.400944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ec8ed-de74-4fa7-bce8-b4e3fbb9df2a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.411169 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ec8ed-de74-4fa7-bce8-b4e3fbb9df2a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.415855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5f536-de06-471a-9d0d-3d23c0261603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.416733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f536-de06-471a-9d0d-3d23c0261603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.417021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f536-de06-471a-9d0d-3d23c0261603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.417302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5f536-de06-471a-9d0d-3d23c0261603 admin admin] PATH_INFO: `/v3/projects/e35523bc5b504331b8bbc7b9e8d304df/users/d746824c578947c3bcdd55a39e81f3f5/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.432406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5f536-de06-471a-9d0d-3d23c0261603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e35523bc5b504331b8bbc7b9e8d304df, user_id=d746824c578947c3bcdd55a39e81f3f5, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.435250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c5f536-de06-471a-9d0d-3d23c0261603 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.449299 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1332/2649] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:24:37 2022] PUT /identity/v3/projects/e35523bc5b504331b8bbc7b9e8d304df/users/d746824c578947c3bcdd55a39e81f3f5/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:37.459772 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bbe6f-313b-4bbb-9271-64bcc3c73619 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.460132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bbe6f-313b-4bbb-9271-64bcc3c73619 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.460417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bbe6f-313b-4bbb-9271-64bcc3c73619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.486500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a92bbe6f-313b-4bbb-9271-64bcc3c73619 None None] MFA Rules not processed for user `d746824c578947c3bcdd55a39e81f3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:37.488265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a92bbe6f-313b-4bbb-9271-64bcc3c73619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:37.558675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1318/2650] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:24:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:37.563110 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5f536-de06-471a-9d0d-3d23c0261603 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.626612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5f536-de06-471a-9d0d-3d23c0261603 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.631384 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866643a-5043-446b-89d8-1fdf96fc98dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.632051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866643a-5043-446b-89d8-1fdf96fc98dd admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.632340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866643a-5043-446b-89d8-1fdf96fc98dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.632625 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866643a-5043-446b-89d8-1fdf96fc98dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.633337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866643a-5043-446b-89d8-1fdf96fc98dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.635598 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866643a-5043-446b-89d8-1fdf96fc98dd admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.662582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1333/2651] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:24:37 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:24:37.666988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bbe6f-313b-4bbb-9271-64bcc3c73619 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.677520 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bbe6f-313b-4bbb-9271-64bcc3c73619 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.722374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:37.735449 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90eb6d-f068-4f74-aa07-9378806d1182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.736152 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90eb6d-f068-4f74-aa07-9378806d1182 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.736436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90eb6d-f068-4f74-aa07-9378806d1182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.736823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90eb6d-f068-4f74-aa07-9378806d1182 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.737563 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90eb6d-f068-4f74-aa07-9378806d1182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.739514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90eb6d-f068-4f74-aa07-9378806d1182 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.759907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1319/2652] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:24:37 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:24:37.764067 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866643a-5043-446b-89d8-1fdf96fc98dd admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.775405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866643a-5043-446b-89d8-1fdf96fc98dd admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.779970 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571370e-b76b-4bbb-8154-7eef943040d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.780629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571370e-b76b-4bbb-8154-7eef943040d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.780914 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571370e-b76b-4bbb-8154-7eef943040d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.781195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571370e-b76b-4bbb-8154-7eef943040d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.781924 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571370e-b76b-4bbb-8154-7eef943040d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.783576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571370e-b76b-4bbb-8154-7eef943040d7 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.794145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1334/2653] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:24:37.798379 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90eb6d-f068-4f74-aa07-9378806d1182 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.808578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90eb6d-f068-4f74-aa07-9378806d1182 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.813374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca1551-f1d7-49a5-a7ed-db8308261a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.814266 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca1551-f1d7-49a5-a7ed-db8308261a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.814578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca1551-f1d7-49a5-a7ed-db8308261a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.814859 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca1551-f1d7-49a5-a7ed-db8308261a01 admin admin] PATH_INFO: `/v3/projects/f70445907ba241e1830de5859f587d44/users/8eb5623886e3492cba502dee4e14a005/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.829940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca1551-f1d7-49a5-a7ed-db8308261a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70445907ba241e1830de5859f587d44, user_id=8eb5623886e3492cba502dee4e14a005, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.833333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca1551-f1d7-49a5-a7ed-db8308261a01 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.847951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1320/2654] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:24:37 2022] PUT /identity/v3/projects/f70445907ba241e1830de5859f587d44/users/8eb5623886e3492cba502dee4e14a005/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:24:37.852139 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571370e-b76b-4bbb-8154-7eef943040d7 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.862223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571370e-b76b-4bbb-8154-7eef943040d7 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.895851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:37.921462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039a01a-19a1-456e-a4a9-a8aff46a4365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.922141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039a01a-19a1-456e-a4a9-a8aff46a4365 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.922454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039a01a-19a1-456e-a4a9-a8aff46a4365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.922734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039a01a-19a1-456e-a4a9-a8aff46a4365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.923467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039a01a-19a1-456e-a4a9-a8aff46a4365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.925060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039a01a-19a1-456e-a4a9-a8aff46a4365 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.934964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1335/2655] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:24:37.940073 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca1551-f1d7-49a5-a7ed-db8308261a01 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:37.951203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca1551-f1d7-49a5-a7ed-db8308261a01 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:37.956028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad1239-75b5-483f-9e43-839bc1170f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:37.957555 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad1239-75b5-483f-9e43-839bc1170f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.957837 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad1239-75b5-483f-9e43-839bc1170f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.958121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad1239-75b5-483f-9e43-839bc1170f6b admin admin] PATH_INFO: `/v3/projects/f70445907ba241e1830de5859f587d44/users/8eb5623886e3492cba502dee4e14a005/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:37.960194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad1239-75b5-483f-9e43-839bc1170f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70445907ba241e1830de5859f587d44, user_id=8eb5623886e3492cba502dee4e14a005, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:37.963033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad1239-75b5-483f-9e43-839bc1170f6b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:37.975089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1321/2656] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:24:37 2022] PUT /identity/v3/projects/f70445907ba241e1830de5859f587d44/users/8eb5623886e3492cba502dee4e14a005/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:24:37.986748 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c90cf-0c52-4de9-8ae7-4ba165686e5c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:37.987042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c90cf-0c52-4de9-8ae7-4ba165686e5c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:37.987322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c90cf-0c52-4de9-8ae7-4ba165686e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:38.013939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c04c90cf-0c52-4de9-8ae7-4ba165686e5c None None] MFA Rules not processed for user `8eb5623886e3492cba502dee4e14a005`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:24:38.015197 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c04c90cf-0c52-4de9-8ae7-4ba165686e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:38.084848 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1336/2657] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:24:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:24:38.096112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad1239-75b5-483f-9e43-839bc1170f6b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:38.098845 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-73ad1239-75b5-483f-9e43-839bc1170f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:24:38.161007 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad1239-75b5-483f-9e43-839bc1170f6b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:38.164732 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709327-e991-426f-b73d-fcf5880c71bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:38.165388 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709327-e991-426f-b73d-fcf5880c71bb service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:38.165676 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709327-e991-426f-b73d-fcf5880c71bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:38.165955 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709327-e991-426f-b73d-fcf5880c71bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:38.176089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5709327-e991-426f-b73d-fcf5880c71bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:38.177532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5709327-e991-426f-b73d-fcf5880c71bb service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:38.187064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1322/2658] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:38.264570 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c90cf-0c52-4de9-8ae7-4ba165686e5c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:24:38.274668 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c90cf-0c52-4de9-8ae7-4ba165686e5c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:24:38.278908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675edad1-bccf-4e87-a6fd-d72040381765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:24:38.279559 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675edad1-bccf-4e87-a6fd-d72040381765 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:24:38.279847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675edad1-bccf-4e87-a6fd-d72040381765 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:24:38.280128 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675edad1-bccf-4e87-a6fd-d72040381765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:24:38.337845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675edad1-bccf-4e87-a6fd-d72040381765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:24:38.339265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675edad1-bccf-4e87-a6fd-d72040381765 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:24:38.349134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1337/2659] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:24:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:24:48.182795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=48,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:24:48.344120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=74 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:06.573466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709327-e991-426f-b73d-fcf5880c71bb service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:06.574949 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d5709327-e991-426f-b73d-fcf5880c71bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:06.648820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709327-e991-426f-b73d-fcf5880c71bb service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:06.653478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28f543-6584-4e18-8d13-1c8db02bacdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:06.654329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28f543-6584-4e18-8d13-1c8db02bacdf service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:06.654629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28f543-6584-4e18-8d13-1c8db02bacdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:06.655324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28f543-6584-4e18-8d13-1c8db02bacdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:06.657429 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4d28f543-6584-4e18-8d13-1c8db02bacdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:06.724136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28f543-6584-4e18-8d13-1c8db02bacdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:06.725600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28f543-6584-4e18-8d13-1c8db02bacdf service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:06.735878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1323/2660] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:09.985549 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675edad1-bccf-4e87-a6fd-d72040381765 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:09.987131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-675edad1-bccf-4e87-a6fd-d72040381765 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:10.066675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28f543-6584-4e18-8d13-1c8db02bacdf service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:10.068274 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4d28f543-6584-4e18-8d13-1c8db02bacdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:10.084729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28f543-6584-4e18-8d13-1c8db02bacdf service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:10.090622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2c8c2-63e0-4344-9cb9-bab7a3ee25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:10.091566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c8c2-63e0-4344-9cb9-bab7a3ee25a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.091884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c8c2-63e0-4344-9cb9-bab7a3ee25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.092227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c8c2-63e0-4344-9cb9-bab7a3ee25a6 admin admin] PATH_INFO: `/v3/users/5bbea49c1a55481c9995f04f2e9b8618` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.093560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2c8c2-63e0-4344-9cb9-bab7a3ee25a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbea49c1a55481c9995f04f2e9b8618)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:10.095960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2c8c2-63e0-4344-9cb9-bab7a3ee25a6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:10.097380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675edad1-bccf-4e87-a6fd-d72040381765 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:10.105200 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fdacb-34d0-4d2f-99c1-ad35b6bd32ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:10.106101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fdacb-34d0-4d2f-99c1-ad35b6bd32ff service placement] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.106497 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fdacb-34d0-4d2f-99c1-ad35b6bd32ff service placement] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.106867 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fdacb-34d0-4d2f-99c1-ad35b6bd32ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.111475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-303fdacb-34d0-4d2f-99c1-ad35b6bd32ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:10.127328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fdacb-34d0-4d2f-99c1-ad35b6bd32ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:10.129106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fdacb-34d0-4d2f-99c1-ad35b6bd32ff service placement] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:10.141286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1338/2661] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:10.152449 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fba2c8c2-63e0-4344-9cb9-bab7a3ee25a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbea49c1a55481c9995f04f2e9b8618'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:10.153132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fba2c8c2-63e0-4344-9cb9-bab7a3ee25a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbea49c1a55481c9995f04f2e9b8618'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:10.153756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fba2c8c2-63e0-4344-9cb9-bab7a3ee25a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbea49c1a55481c9995f04f2e9b8618'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:10.161422 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fba2c8c2-63e0-4344-9cb9-bab7a3ee25a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbea49c1a55481c9995f04f2e9b8618'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:10.182537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fba2c8c2-63e0-4344-9cb9-bab7a3ee25a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbea49c1a55481c9995f04f2e9b8618'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:10.197102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1324/2662] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:10 2022] DELETE /identity/v3/users/5bbea49c1a55481c9995f04f2e9b8618 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:10.383649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fdacb-34d0-4d2f-99c1-ad35b6bd32ff service placement] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:10.402136 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fdacb-34d0-4d2f-99c1-ad35b6bd32ff service placement] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:10.459607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:10.460474 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.461281 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.461577 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] PATH_INFO: `/v3/projects/30c5e99c9761441fbad367a0bb8e1e66` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.462876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30c5e99c9761441fbad367a0bb8e1e66)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:10.464825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:10.511235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c5e99c9761441fbad367a0bb8e1e66', 'request_id': 'req-3747f6f6-e787-4159-8878-e37e9d017e89'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:10.517400 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c5e99c9761441fbad367a0bb8e1e66', 'request_id': 'req-3747f6f6-e787-4159-8878-e37e9d017e89'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:10.522982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c5e99c9761441fbad367a0bb8e1e66', 'request_id': 'req-3747f6f6-e787-4159-8878-e37e9d017e89'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:10.535865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] The token cache is being invalidate because project 30c5e99c9761441fbad367a0bb8e1e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:10.536158 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:10.536772 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-3747f6f6-e787-4159-8878-e37e9d017e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:10.538382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1339/2663] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:10 2022] DELETE /identity/v3/projects/30c5e99c9761441fbad367a0bb8e1e66 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:10.545183 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0324ad-f7fa-490d-a876-59e37f053eb0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.545472 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0324ad-f7fa-490d-a876-59e37f053eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.545758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0324ad-f7fa-490d-a876-59e37f053eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.565141 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ec0324ad-f7fa-490d-a876-59e37f053eb0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:10.566329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ec0324ad-f7fa-490d-a876-59e37f053eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:10.585675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:10.630940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1325/2664] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:10.641071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822fd2c-b9f6-472d-9b65-161865ee1f75 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.641364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822fd2c-b9f6-472d-9b65-161865ee1f75 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.641679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822fd2c-b9f6-472d-9b65-161865ee1f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.661052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-8822fd2c-b9f6-472d-9b65-161865ee1f75 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:10.662295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-8822fd2c-b9f6-472d-9b65-161865ee1f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:10.670313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1340/2665] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:10.674531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0324ad-f7fa-490d-a876-59e37f053eb0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:10.684348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0324ad-f7fa-490d-a876-59e37f053eb0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:10.688964 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329e3d8-3f82-42ad-83c1-bf153da61408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:10.689619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329e3d8-3f82-42ad-83c1-bf153da61408 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.689897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329e3d8-3f82-42ad-83c1-bf153da61408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.690192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329e3d8-3f82-42ad-83c1-bf153da61408 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.690926 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329e3d8-3f82-42ad-83c1-bf153da61408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:10.691230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329e3d8-3f82-42ad-83c1-bf153da61408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:10.692840 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d329e3d8-3f82-42ad-83c1-bf153da61408 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:10.704929 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1326/2666] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:10.709238 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822fd2c-b9f6-472d-9b65-161865ee1f75 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:10.719141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822fd2c-b9f6-472d-9b65-161865ee1f75 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:10.723797 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ec1ba-a341-43b7-9bdd-1f50cd4ef21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:10.724447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ec1ba-a341-43b7-9bdd-1f50cd4ef21c admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.724731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ec1ba-a341-43b7-9bdd-1f50cd4ef21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.725010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ec1ba-a341-43b7-9bdd-1f50cd4ef21c admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.725711 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ec1ba-a341-43b7-9bdd-1f50cd4ef21c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:10.727759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ec1ba-a341-43b7-9bdd-1f50cd4ef21c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:10.737612 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:10.755478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1341/2667] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:10 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:10.760441 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329e3d8-3f82-42ad-83c1-bf153da61408 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:10.776225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329e3d8-3f82-42ad-83c1-bf153da61408 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:10.831328 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035a539-9648-4f5e-88a3-e460bad2f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:10.831914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035a539-9648-4f5e-88a3-e460bad2f3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.832199 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035a539-9648-4f5e-88a3-e460bad2f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.832474 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035a539-9648-4f5e-88a3-e460bad2f3b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.833188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035a539-9648-4f5e-88a3-e460bad2f3b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:10.835132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1035a539-9648-4f5e-88a3-e460bad2f3b1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:10.855697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1327/2668] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:10 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:10.860307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ec1ba-a341-43b7-9bdd-1f50cd4ef21c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:10.871170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ec1ba-a341-43b7-9bdd-1f50cd4ef21c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:10.875846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb08b4-5291-4705-99a3-46e506fa2b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:10.876510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb08b4-5291-4705-99a3-46e506fa2b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.876795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb08b4-5291-4705-99a3-46e506fa2b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.877074 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb08b4-5291-4705-99a3-46e506fa2b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.877798 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb08b4-5291-4705-99a3-46e506fa2b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:10.879414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb08b4-5291-4705-99a3-46e506fa2b16 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:10.890213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1342/2669] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:10.894311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035a539-9648-4f5e-88a3-e460bad2f3b1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:10.905241 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035a539-9648-4f5e-88a3-e460bad2f3b1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:10.909898 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b02a52-53d6-46a0-b2d4-ea70ce86c453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:10.910601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b02a52-53d6-46a0-b2d4-ea70ce86c453 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.910887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b02a52-53d6-46a0-b2d4-ea70ce86c453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.911165 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b02a52-53d6-46a0-b2d4-ea70ce86c453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.911891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b02a52-53d6-46a0-b2d4-ea70ce86c453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:10.913490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b02a52-53d6-46a0-b2d4-ea70ce86c453 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:10.923539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1328/2670] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:10.927682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb08b4-5291-4705-99a3-46e506fa2b16 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:10.938223 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb08b4-5291-4705-99a3-46e506fa2b16 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:10.942743 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86082ab7-12cd-4d5f-85b3-2b74e09e9ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:10.943620 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86082ab7-12cd-4d5f-85b3-2b74e09e9ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.943904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86082ab7-12cd-4d5f-85b3-2b74e09e9ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.944180 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86082ab7-12cd-4d5f-85b3-2b74e09e9ac2 admin admin] PATH_INFO: `/v3/projects/854f8f12c63f4566b07861c627398ffd/users/19469ae93b144e9c93eea412e432cd91/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:10.961060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86082ab7-12cd-4d5f-85b3-2b74e09e9ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854f8f12c63f4566b07861c627398ffd, user_id=19469ae93b144e9c93eea412e432cd91, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:10.963839 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86082ab7-12cd-4d5f-85b3-2b74e09e9ac2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:10.976730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1343/2671] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:10 2022] PUT /identity/v3/projects/854f8f12c63f4566b07861c627398ffd/users/19469ae93b144e9c93eea412e432cd91/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:10.986947 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92912639-44b7-42d5-83cd-e402cf9a210f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:10.987267 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92912639-44b7-42d5-83cd-e402cf9a210f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:10.987549 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92912639-44b7-42d5-83cd-e402cf9a210f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:11.015102 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-92912639-44b7-42d5-83cd-e402cf9a210f None None] MFA Rules not processed for user `19469ae93b144e9c93eea412e432cd91`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:11.016322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-92912639-44b7-42d5-83cd-e402cf9a210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:11.085628 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1329/2672] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:11.097616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86082ab7-12cd-4d5f-85b3-2b74e09e9ac2 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:11.099522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-86082ab7-12cd-4d5f-85b3-2b74e09e9ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:11.173881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86082ab7-12cd-4d5f-85b3-2b74e09e9ac2 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:11.180221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0f09a-9a2a-4f24-8003-8b9330968914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:11.180960 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0f09a-9a2a-4f24-8003-8b9330968914 service nova] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:11.181247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0f09a-9a2a-4f24-8003-8b9330968914 service nova] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:11.181530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0f09a-9a2a-4f24-8003-8b9330968914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:11.189469 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0f09a-9a2a-4f24-8003-8b9330968914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:11.191131 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0f09a-9a2a-4f24-8003-8b9330968914 service nova] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:11.203364 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1344/2673] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:20.633054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92912639-44b7-42d5-83cd-e402cf9a210f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:20.653375 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:20.703370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92912639-44b7-42d5-83cd-e402cf9a210f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:20.708112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:20.708992 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:20.709195 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:20.709469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] PATH_INFO: `/v3/users/19469ae93b144e9c93eea412e432cd91` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:20.710880 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19469ae93b144e9c93eea412e432cd91)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:20.712850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:20.767141 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19469ae93b144e9c93eea412e432cd91'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:20.767807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19469ae93b144e9c93eea412e432cd91'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:20.768543 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19469ae93b144e9c93eea412e432cd91'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:20.775604 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19469ae93b144e9c93eea412e432cd91'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:20.791227 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19469ae93b144e9c93eea412e432cd91'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:20.804746 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1330/2674] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:20 2022] DELETE /identity/v3/users/19469ae93b144e9c93eea412e432cd91 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:20.809327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628085a0-a758-4ce5-99ec-80061329d3a7 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:20.809853 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628085a0-a758-4ce5-99ec-80061329d3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:20.809957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628085a0-a758-4ce5-99ec-80061329d3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:20.827354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-628085a0-a758-4ce5-99ec-80061329d3a7 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:20.828565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-628085a0-a758-4ce5-99ec-80061329d3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:20.888677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1345/2675] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:20.898376 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:20.899817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:20.959514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08360e-8834-422e-87ba-e70419eef31c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:20.963476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42a97c-ddbf-44ad-b68f-acf3b07e2738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:20.964058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42a97c-ddbf-44ad-b68f-acf3b07e2738 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:20.964344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42a97c-ddbf-44ad-b68f-acf3b07e2738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:20.964625 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42a97c-ddbf-44ad-b68f-acf3b07e2738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:20.974041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42a97c-ddbf-44ad-b68f-acf3b07e2738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:20.975559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42a97c-ddbf-44ad-b68f-acf3b07e2738 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:20.985256 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1331/2676] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:21.267498 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628085a0-a758-4ce5-99ec-80061329d3a7 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:21.269029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-628085a0-a758-4ce5-99ec-80061329d3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:21.284214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628085a0-a758-4ce5-99ec-80061329d3a7 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:21.289595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:21.290510 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:21.290819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:21.291177 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] PATH_INFO: `/v3/projects/854f8f12c63f4566b07861c627398ffd` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:21.292278 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=854f8f12c63f4566b07861c627398ffd)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:21.294251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:21.333597 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:21.343818 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854f8f12c63f4566b07861c627398ffd', 'request_id': 'req-27393138-e20f-43a0-941c-f498381e66c4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:21.350033 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854f8f12c63f4566b07861c627398ffd', 'request_id': 'req-27393138-e20f-43a0-941c-f498381e66c4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:21.356186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854f8f12c63f4566b07861c627398ffd', 'request_id': 'req-27393138-e20f-43a0-941c-f498381e66c4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:21.370186 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] The token cache is being invalidate because project 854f8f12c63f4566b07861c627398ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:21.370507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:21.371146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-27393138-e20f-43a0-941c-f498381e66c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:21.372737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1346/2677] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:21 2022] DELETE /identity/v3/projects/854f8f12c63f4566b07861c627398ffd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:21.377728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875dec9-569f-4515-a8e7-0bb5cdedf4c1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:21.378018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875dec9-569f-4515-a8e7-0bb5cdedf4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:21.378351 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875dec9-569f-4515-a8e7-0bb5cdedf4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:21.396330 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9875dec9-569f-4515-a8e7-0bb5cdedf4c1 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:21.398058 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9875dec9-569f-4515-a8e7-0bb5cdedf4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:21.433325 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:21.461026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1332/2678] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:21.469470 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d4ca8-9435-416a-9162-67386062d180 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:21.469757 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d4ca8-9435-416a-9162-67386062d180 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:21.470040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d4ca8-9435-416a-9162-67386062d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:21.489078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-164d4ca8-9435-416a-9162-67386062d180 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:21.490397 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-164d4ca8-9435-416a-9162-67386062d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:21.498749 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1347/2679] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:21.503216 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875dec9-569f-4515-a8e7-0bb5cdedf4c1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:21.513211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875dec9-569f-4515-a8e7-0bb5cdedf4c1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:21.518125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e2819-c21a-492d-b8b2-c06643da0755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:21.518873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e2819-c21a-492d-b8b2-c06643da0755 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:21.519164 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e2819-c21a-492d-b8b2-c06643da0755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:21.519446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e2819-c21a-492d-b8b2-c06643da0755 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:21.520303 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e2819-c21a-492d-b8b2-c06643da0755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:21.520622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e2819-c21a-492d-b8b2-c06643da0755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:21.522310 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e2819-c21a-492d-b8b2-c06643da0755 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:21.534968 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1333/2680] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:21.540055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d4ca8-9435-416a-9162-67386062d180 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:21.549550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d4ca8-9435-416a-9162-67386062d180 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:21.554386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae98a0-301f-4e43-81dd-ea1e0ee30032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:21.555649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae98a0-301f-4e43-81dd-ea1e0ee30032 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:21.555649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae98a0-301f-4e43-81dd-ea1e0ee30032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:21.555649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae98a0-301f-4e43-81dd-ea1e0ee30032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:21.556333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae98a0-301f-4e43-81dd-ea1e0ee30032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:21.558302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae98a0-301f-4e43-81dd-ea1e0ee30032 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:21.587374 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1348/2681] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:21 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:21.588692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e2819-c21a-492d-b8b2-c06643da0755 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:21.598648 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e2819-c21a-492d-b8b2-c06643da0755 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:21.656705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c910dce-ba92-408e-9d4d-5405ebe24f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:21.657402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c910dce-ba92-408e-9d4d-5405ebe24f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:21.657660 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c910dce-ba92-408e-9d4d-5405ebe24f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:21.657940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c910dce-ba92-408e-9d4d-5405ebe24f3a admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:21.658682 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c910dce-ba92-408e-9d4d-5405ebe24f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:21.660618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c910dce-ba92-408e-9d4d-5405ebe24f3a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:21.682643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1334/2682] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:21 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:21.686795 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae98a0-301f-4e43-81dd-ea1e0ee30032 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:21.697475 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae98a0-301f-4e43-81dd-ea1e0ee30032 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:21.702241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f180e-9bbc-45c1-8bf5-67db152ab14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:21.702975 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f180e-9bbc-45c1-8bf5-67db152ab14d admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:21.703271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f180e-9bbc-45c1-8bf5-67db152ab14d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:21.703552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f180e-9bbc-45c1-8bf5-67db152ab14d admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:21.704291 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f180e-9bbc-45c1-8bf5-67db152ab14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:21.705891 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f180e-9bbc-45c1-8bf5-67db152ab14d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:21.717548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1349/2683] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:21.721743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c910dce-ba92-408e-9d4d-5405ebe24f3a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:21.732891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c910dce-ba92-408e-9d4d-5405ebe24f3a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:21.737595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551ef44-5d3a-4b5a-8495-fd49e027a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:21.738296 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551ef44-5d3a-4b5a-8495-fd49e027a100 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:21.738578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551ef44-5d3a-4b5a-8495-fd49e027a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:21.738848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551ef44-5d3a-4b5a-8495-fd49e027a100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:21.739561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551ef44-5d3a-4b5a-8495-fd49e027a100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:21.741537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551ef44-5d3a-4b5a-8495-fd49e027a100 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:21.751518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1335/2684] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:21.755993 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f180e-9bbc-45c1-8bf5-67db152ab14d admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:21.766062 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f180e-9bbc-45c1-8bf5-67db152ab14d admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:21.770833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438dd35-266c-4e24-8d3e-63312320c9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:21.771733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438dd35-266c-4e24-8d3e-63312320c9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:21.772025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438dd35-266c-4e24-8d3e-63312320c9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:21.772308 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438dd35-266c-4e24-8d3e-63312320c9d3 admin admin] PATH_INFO: `/v3/projects/eec7ab3f78214b829fd26b22111aa4a3/users/090a97c9e79c45afaa6670c0628144cc/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:21.787561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438dd35-266c-4e24-8d3e-63312320c9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec7ab3f78214b829fd26b22111aa4a3, user_id=090a97c9e79c45afaa6670c0628144cc, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:21.791005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438dd35-266c-4e24-8d3e-63312320c9d3 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:21.805667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1350/2685] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:21 2022] PUT /identity/v3/projects/eec7ab3f78214b829fd26b22111aa4a3/users/090a97c9e79c45afaa6670c0628144cc/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:21.817629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ce564-9d54-46c9-8e95-f3d6598d9622 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:21.817945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ce564-9d54-46c9-8e95-f3d6598d9622 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:21.821787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ce564-9d54-46c9-8e95-f3d6598d9622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:21.852157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fc0ce564-9d54-46c9-8e95-f3d6598d9622 None None] MFA Rules not processed for user `090a97c9e79c45afaa6670c0628144cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:21.853389 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fc0ce564-9d54-46c9-8e95-f3d6598d9622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:21.923133 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1336/2686] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:21.927980 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438dd35-266c-4e24-8d3e-63312320c9d3 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:21.999121 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438dd35-266c-4e24-8d3e-63312320c9d3 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.003927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d728c0-ef1c-4939-95f7-351e27ee15b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.004596 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d728c0-ef1c-4939-95f7-351e27ee15b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.004887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d728c0-ef1c-4939-95f7-351e27ee15b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.005169 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d728c0-ef1c-4939-95f7-351e27ee15b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.005878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d728c0-ef1c-4939-95f7-351e27ee15b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.008651 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d728c0-ef1c-4939-95f7-351e27ee15b9 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.035410 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1351/2687] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:21 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:22.040320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ce564-9d54-46c9-8e95-f3d6598d9622 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.051171 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ce564-9d54-46c9-8e95-f3d6598d9622 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.085902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:22.112409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7a254-0ec4-455f-872f-80df8dd6e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.113319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7a254-0ec4-455f-872f-80df8dd6e502 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.113606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7a254-0ec4-455f-872f-80df8dd6e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.114028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7a254-0ec4-455f-872f-80df8dd6e502 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.114684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7a254-0ec4-455f-872f-80df8dd6e502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.117925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7a254-0ec4-455f-872f-80df8dd6e502 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.139590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1337/2688] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:22 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:22.143816 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d728c0-ef1c-4939-95f7-351e27ee15b9 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.155004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d728c0-ef1c-4939-95f7-351e27ee15b9 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.160701 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc70955-e253-4246-9e88-918b287c5f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.161394 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc70955-e253-4246-9e88-918b287c5f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.161689 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc70955-e253-4246-9e88-918b287c5f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.161993 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc70955-e253-4246-9e88-918b287c5f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.162991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc70955-e253-4246-9e88-918b287c5f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.165626 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc70955-e253-4246-9e88-918b287c5f36 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.177611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1352/2689] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:22.182106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7a254-0ec4-455f-872f-80df8dd6e502 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.187669 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc70955-e253-4246-9e88-918b287c5f36 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.189385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-4cc70955-e253-4246-9e88-918b287c5f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.195097 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7a254-0ec4-455f-872f-80df8dd6e502 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.204232 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95b512-f80c-4610-9eba-6db8d5e0720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.205446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95b512-f80c-4610-9eba-6db8d5e0720b admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.205726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95b512-f80c-4610-9eba-6db8d5e0720b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.205997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95b512-f80c-4610-9eba-6db8d5e0720b admin admin] PATH_INFO: `/v3/projects/f1123d3214e845f8ac9438be88ce4b29/users/520ebb3f48734c1cb614e87caced4b89/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.211819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc70955-e253-4246-9e88-918b287c5f36 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.217858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1928e-8b2a-455c-852f-14a02a29c3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.218819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1928e-8b2a-455c-852f-14a02a29c3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.219109 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1928e-8b2a-455c-852f-14a02a29c3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.219387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1928e-8b2a-455c-852f-14a02a29c3b4 admin admin] PATH_INFO: `/v3/users/d746824c578947c3bcdd55a39e81f3f5` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.220754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1928e-8b2a-455c-852f-14a02a29c3b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d746824c578947c3bcdd55a39e81f3f5)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.222667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1928e-8b2a-455c-852f-14a02a29c3b4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.224016 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95b512-f80c-4610-9eba-6db8d5e0720b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1123d3214e845f8ac9438be88ce4b29, user_id=520ebb3f48734c1cb614e87caced4b89, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.227535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95b512-f80c-4610-9eba-6db8d5e0720b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.243096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1338/2690] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:22 2022] PUT /identity/v3/projects/f1123d3214e845f8ac9438be88ce4b29/users/520ebb3f48734c1cb614e87caced4b89/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:22.246939 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95b512-f80c-4610-9eba-6db8d5e0720b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.260603 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:22.276608 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d8f1928e-8b2a-455c-852f-14a02a29c3b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd746824c578947c3bcdd55a39e81f3f5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:22.277405 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d8f1928e-8b2a-455c-852f-14a02a29c3b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd746824c578947c3bcdd55a39e81f3f5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:22.278036 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d8f1928e-8b2a-455c-852f-14a02a29c3b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd746824c578947c3bcdd55a39e81f3f5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:22.286933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d8f1928e-8b2a-455c-852f-14a02a29c3b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd746824c578947c3bcdd55a39e81f3f5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:22.295699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-d8f1928e-8b2a-455c-852f-14a02a29c3b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd746824c578947c3bcdd55a39e81f3f5'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:22.313406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95b512-f80c-4610-9eba-6db8d5e0720b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.314552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1353/2691] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:22 2022] DELETE /identity/v3/users/d746824c578947c3bcdd55a39e81f3f5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:22.319089 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f237-f098-43d7-a603-4f3c15302177 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.319447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f237-f098-43d7-a603-4f3c15302177 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.319801 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11f237-f098-43d7-a603-4f3c15302177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.337899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-fb11f237-f098-43d7-a603-4f3c15302177 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:22.339327 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fb11f237-f098-43d7-a603-4f3c15302177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.373466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336284f-9b31-48cb-9d26-b35f4bccf002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.374147 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336284f-9b31-48cb-9d26-b35f4bccf002 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.374466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336284f-9b31-48cb-9d26-b35f4bccf002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.374749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336284f-9b31-48cb-9d26-b35f4bccf002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.375478 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336284f-9b31-48cb-9d26-b35f4bccf002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.377142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336284f-9b31-48cb-9d26-b35f4bccf002 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.387766 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1339/2692] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:22.391860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336284f-9b31-48cb-9d26-b35f4bccf002 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.393621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4336284f-9b31-48cb-9d26-b35f4bccf002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.405344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1354/2693] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:22.406715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336284f-9b31-48cb-9d26-b35f4bccf002 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.411715 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aee0f1-abe5-4147-82d3-2177a0cee929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.412601 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aee0f1-abe5-4147-82d3-2177a0cee929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.412882 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aee0f1-abe5-4147-82d3-2177a0cee929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.413600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aee0f1-abe5-4147-82d3-2177a0cee929 admin admin] PATH_INFO: `/v3/projects/f1123d3214e845f8ac9438be88ce4b29/users/520ebb3f48734c1cb614e87caced4b89/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.414962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11f237-f098-43d7-a603-4f3c15302177 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.415791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aee0f1-abe5-4147-82d3-2177a0cee929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1123d3214e845f8ac9438be88ce4b29, user_id=520ebb3f48734c1cb614e87caced4b89, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.416298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-fb11f237-f098-43d7-a603-4f3c15302177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.418435 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aee0f1-abe5-4147-82d3-2177a0cee929 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.430409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1340/2694] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:22 2022] PUT /identity/v3/projects/f1123d3214e845f8ac9438be88ce4b29/users/520ebb3f48734c1cb614e87caced4b89/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:22.440629 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3671b5-fba2-44c0-a094-6d3ee492dcb0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.441065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3671b5-fba2-44c0-a094-6d3ee492dcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.441347 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3671b5-fba2-44c0-a094-6d3ee492dcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.468106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3e3671b5-fba2-44c0-a094-6d3ee492dcb0 None None] MFA Rules not processed for user `520ebb3f48734c1cb614e87caced4b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:22.469323 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3e3671b5-fba2-44c0-a094-6d3ee492dcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.475852 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11f237-f098-43d7-a603-4f3c15302177 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.490076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:22.526754 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed11a5-4285-4652-a25c-c81dc7375424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.527407 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed11a5-4285-4652-a25c-c81dc7375424 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.527693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed11a5-4285-4652-a25c-c81dc7375424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.527975 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed11a5-4285-4652-a25c-c81dc7375424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.545170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1341/2695] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:22.545411 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:22.558017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3671b5-fba2-44c0-a094-6d3ee492dcb0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.559607 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3e3671b5-fba2-44c0-a094-6d3ee492dcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.594367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed11a5-4285-4652-a25c-c81dc7375424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.595829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed11a5-4285-4652-a25c-c81dc7375424 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.606008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1355/2696] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:25:22.617933 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3671b5-fba2-44c0-a094-6d3ee492dcb0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.621706 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd294-fc33-4df3-ac8b-dbd6346337c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.622515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd294-fc33-4df3-ac8b-dbd6346337c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.622807 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd294-fc33-4df3-ac8b-dbd6346337c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.623220 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd294-fc33-4df3-ac8b-dbd6346337c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.633484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd294-fc33-4df3-ac8b-dbd6346337c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.635194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd294-fc33-4df3-ac8b-dbd6346337c7 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.646315 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1342/2697] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:25:22.692504 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed11a5-4285-4652-a25c-c81dc7375424 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.694082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b6ed11a5-4285-4652-a25c-c81dc7375424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.708431 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed11a5-4285-4652-a25c-c81dc7375424 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.713859 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f12b9d-6f6a-49b2-90c8-7512eef814d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.714567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f12b9d-6f6a-49b2-90c8-7512eef814d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.714860 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f12b9d-6f6a-49b2-90c8-7512eef814d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.715145 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f12b9d-6f6a-49b2-90c8-7512eef814d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.717043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-01f12b9d-6f6a-49b2-90c8-7512eef814d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.781114 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f12b9d-6f6a-49b2-90c8-7512eef814d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.782434 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f12b9d-6f6a-49b2-90c8-7512eef814d0 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.791641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1356/2698] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:22.890466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd294-fc33-4df3-ac8b-dbd6346337c7 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:22.892373 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-69ddd294-fc33-4df3-ac8b-dbd6346337c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:22.913920 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd294-fc33-4df3-ac8b-dbd6346337c7 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:22.919068 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:22.920090 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:22.920394 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:22.920810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] PATH_INFO: `/v3/projects/e35523bc5b504331b8bbc7b9e8d304df` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:22.921916 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e35523bc5b504331b8bbc7b9e8d304df)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:22.923944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:22.978057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e35523bc5b504331b8bbc7b9e8d304df', 'request_id': 'req-a8384f26-aac9-498c-bc14-5dad356a65a5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:22.984380 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e35523bc5b504331b8bbc7b9e8d304df', 'request_id': 'req-a8384f26-aac9-498c-bc14-5dad356a65a5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:22.993032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e35523bc5b504331b8bbc7b9e8d304df', 'request_id': 'req-a8384f26-aac9-498c-bc14-5dad356a65a5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.005905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] The token cache is being invalidate because project e35523bc5b504331b8bbc7b9e8d304df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:23.006129 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.007450 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.009154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1343/2699] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:22 2022] DELETE /identity/v3/projects/e35523bc5b504331b8bbc7b9e8d304df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:23.014104 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f12b9d-6f6a-49b2-90c8-7512eef814d0 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:23.025739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f12b9d-6f6a-49b2-90c8-7512eef814d0 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:23.110556 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33d5b7-58d6-4d2b-b649-518804dee8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:23.111455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33d5b7-58d6-4d2b-b649-518804dee8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:23.111777 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33d5b7-58d6-4d2b-b649-518804dee8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:23.112176 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33d5b7-58d6-4d2b-b649-518804dee8c2 admin admin] PATH_INFO: `/v3/users/8eb5623886e3492cba502dee4e14a005` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:23.113707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33d5b7-58d6-4d2b-b649-518804dee8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb5623886e3492cba502dee4e14a005)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:23.116913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33d5b7-58d6-4d2b-b649-518804dee8c2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:23.164451 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-5a33d5b7-58d6-4d2b-b649-518804dee8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb5623886e3492cba502dee4e14a005'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.165111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-5a33d5b7-58d6-4d2b-b649-518804dee8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb5623886e3492cba502dee4e14a005'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.165722 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-5a33d5b7-58d6-4d2b-b649-518804dee8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb5623886e3492cba502dee4e14a005'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.171056 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:23.173481 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-5a33d5b7-58d6-4d2b-b649-518804dee8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb5623886e3492cba502dee4e14a005'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.181685 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-5a33d5b7-58d6-4d2b-b649-518804dee8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb5623886e3492cba502dee4e14a005'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.199964 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1357/2700] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:23 2022] DELETE /identity/v3/users/8eb5623886e3492cba502dee4e14a005 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:23.472194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:23.473664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:23.488851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8384f26-aac9-498c-bc14-5dad356a65a5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:23.532243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:23.550894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:23.553757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:23.555265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:23.555265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] PATH_INFO: `/v3/projects/f70445907ba241e1830de5859f587d44` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:23.555811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70445907ba241e1830de5859f587d44)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:23.557748 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:23.605605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70445907ba241e1830de5859f587d44', 'request_id': 'req-35f71674-322e-4a6e-89c4-510122aef45a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.611077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70445907ba241e1830de5859f587d44', 'request_id': 'req-35f71674-322e-4a6e-89c4-510122aef45a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.619008 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70445907ba241e1830de5859f587d44', 'request_id': 'req-35f71674-322e-4a6e-89c4-510122aef45a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.630342 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] The token cache is being invalidate because project f70445907ba241e1830de5859f587d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:23.630626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.631309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-35f71674-322e-4a6e-89c4-510122aef45a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:23.633353 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1344/2701] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:23 2022] DELETE /identity/v3/projects/f70445907ba241e1830de5859f587d44 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:23.638502 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0e43a-f5e5-492e-b252-6429e87707b9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:23.638854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0e43a-f5e5-492e-b252-6429e87707b9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:23.639237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0e43a-f5e5-492e-b252-6429e87707b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:23.657921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b4f0e43a-f5e5-492e-b252-6429e87707b9 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:23.659208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b4f0e43a-f5e5-492e-b252-6429e87707b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:23.719961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1358/2702] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:23.728062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b193ee-1d0a-4325-bae0-cc41f30a49d7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:23.728356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b193ee-1d0a-4325-bae0-cc41f30a49d7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:23.728640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b193ee-1d0a-4325-bae0-cc41f30a49d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:23.747597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-45b193ee-1d0a-4325-bae0-cc41f30a49d7 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:23.748820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-45b193ee-1d0a-4325-bae0-cc41f30a49d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:23.757977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1345/2703] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:23.762211 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0e43a-f5e5-492e-b252-6429e87707b9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:23.772078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0e43a-f5e5-492e-b252-6429e87707b9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:23.776618 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbcb19-2128-4c76-ac19-dc4ab9c412a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:23.777269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbcb19-2128-4c76-ac19-dc4ab9c412a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:23.777552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbcb19-2128-4c76-ac19-dc4ab9c412a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:23.777831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dbcb19-2128-4c76-ac19-dc4ab9c412a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:23.778581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbcb19-2128-4c76-ac19-dc4ab9c412a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:23.778890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbcb19-2128-4c76-ac19-dc4ab9c412a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:23.780493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dbcb19-2128-4c76-ac19-dc4ab9c412a0 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:23.791952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1359/2704] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:23.796146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b193ee-1d0a-4325-bae0-cc41f30a49d7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:23.805896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b193ee-1d0a-4325-bae0-cc41f30a49d7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:23.810546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b344fc3-7a3c-4309-9f2b-e9a3f47a28d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:23.811203 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b344fc3-7a3c-4309-9f2b-e9a3f47a28d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:23.811492 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b344fc3-7a3c-4309-9f2b-e9a3f47a28d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:23.811791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b344fc3-7a3c-4309-9f2b-e9a3f47a28d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:23.812533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b344fc3-7a3c-4309-9f2b-e9a3f47a28d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:23.814463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b344fc3-7a3c-4309-9f2b-e9a3f47a28d4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:23.841781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1346/2705] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:23 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:23.845913 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbcb19-2128-4c76-ac19-dc4ab9c412a0 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:23.856207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dbcb19-2128-4c76-ac19-dc4ab9c412a0 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:23.911767 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a59b6-6d51-4596-8f35-38d721a1ec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:23.912446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a59b6-6d51-4596-8f35-38d721a1ec5f admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:23.912733 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a59b6-6d51-4596-8f35-38d721a1ec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:23.913054 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a59b6-6d51-4596-8f35-38d721a1ec5f admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:23.913927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a59b6-6d51-4596-8f35-38d721a1ec5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:23.915884 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a59b6-6d51-4596-8f35-38d721a1ec5f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:23.937402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1360/2706] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:23 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:23.941532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b344fc3-7a3c-4309-9f2b-e9a3f47a28d4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:23.953899 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b344fc3-7a3c-4309-9f2b-e9a3f47a28d4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:23.960119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88157ff-4ea7-43d9-b0cc-de43d59ad28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:23.960805 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88157ff-4ea7-43d9-b0cc-de43d59ad28a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:23.961091 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88157ff-4ea7-43d9-b0cc-de43d59ad28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:23.961372 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88157ff-4ea7-43d9-b0cc-de43d59ad28a admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:23.962117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88157ff-4ea7-43d9-b0cc-de43d59ad28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:23.963765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88157ff-4ea7-43d9-b0cc-de43d59ad28a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:23.974631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1347/2707] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:23.979099 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a59b6-6d51-4596-8f35-38d721a1ec5f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:23.989414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a59b6-6d51-4596-8f35-38d721a1ec5f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:23.995172 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62edae-26e5-46b1-8a75-42f2a33d9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:23.995877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62edae-26e5-46b1-8a75-42f2a33d9a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:23.996166 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62edae-26e5-46b1-8a75-42f2a33d9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:23.996444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62edae-26e5-46b1-8a75-42f2a33d9a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:23.997177 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62edae-26e5-46b1-8a75-42f2a33d9a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:23.998819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62edae-26e5-46b1-8a75-42f2a33d9a5b admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:24.010046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1361/2708] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:24.014649 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88157ff-4ea7-43d9-b0cc-de43d59ad28a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.024956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88157ff-4ea7-43d9-b0cc-de43d59ad28a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:24.030962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945bc6c-a630-4bf4-9d07-4c86400f88d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:24.032121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945bc6c-a630-4bf4-9d07-4c86400f88d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.032121 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945bc6c-a630-4bf4-9d07-4c86400f88d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.032386 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945bc6c-a630-4bf4-9d07-4c86400f88d5 admin admin] PATH_INFO: `/v3/projects/30e51cacac45455b8c892a8fd50e72e8/users/c634379613634eb1931878bcc49f49e3/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.049196 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945bc6c-a630-4bf4-9d07-4c86400f88d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e51cacac45455b8c892a8fd50e72e8, user_id=c634379613634eb1931878bcc49f49e3, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:24.051514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945bc6c-a630-4bf4-9d07-4c86400f88d5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:24.067631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1348/2709] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:24 2022] PUT /identity/v3/projects/30e51cacac45455b8c892a8fd50e72e8/users/c634379613634eb1931878bcc49f49e3/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:24.130969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88bc1-b57c-4e31-ae86-06ccb93db582 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.131534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88bc1-b57c-4e31-ae86-06ccb93db582 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.131534 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef88bc1-b57c-4e31-ae86-06ccb93db582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.159053 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-cef88bc1-b57c-4e31-ae86-06ccb93db582 None None] MFA Rules not processed for user `c634379613634eb1931878bcc49f49e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:24.160288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cef88bc1-b57c-4e31-ae86-06ccb93db582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:24.188966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:24.243871 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1362/2710] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:24.248331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945bc6c-a630-4bf4-9d07-4c86400f88d5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.319201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945bc6c-a630-4bf4-9d07-4c86400f88d5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:24.324109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d5f1-2939-461a-9569-0f64316b2ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:24.324771 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d5f1-2939-461a-9569-0f64316b2ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.325060 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d5f1-2939-461a-9569-0f64316b2ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.325339 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d5f1-2939-461a-9569-0f64316b2ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.326084 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36d5f1-2939-461a-9569-0f64316b2ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:24.328028 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36d5f1-2939-461a-9569-0f64316b2ce7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:24.341497 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:24.360656 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1349/2711] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:24 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:24.361844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88bc1-b57c-4e31-ae86-06ccb93db582 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.375111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef88bc1-b57c-4e31-ae86-06ccb93db582 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:24.437057 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344df554-95d2-4d19-92c6-7ae30e1cb676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:24.437770 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344df554-95d2-4d19-92c6-7ae30e1cb676 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.438040 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344df554-95d2-4d19-92c6-7ae30e1cb676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.438354 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344df554-95d2-4d19-92c6-7ae30e1cb676 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.439060 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344df554-95d2-4d19-92c6-7ae30e1cb676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:24.440995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344df554-95d2-4d19-92c6-7ae30e1cb676 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:24.461520 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1363/2712] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:24 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:24.465491 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d5f1-2939-461a-9569-0f64316b2ce7 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.477585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d5f1-2939-461a-9569-0f64316b2ce7 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:24.482935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9b17-761e-47fd-aded-98f4048ddace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:24.483684 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9b17-761e-47fd-aded-98f4048ddace admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.484004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9b17-761e-47fd-aded-98f4048ddace admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.484285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d9b17-761e-47fd-aded-98f4048ddace admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.485005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d9b17-761e-47fd-aded-98f4048ddace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:24.486642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d9b17-761e-47fd-aded-98f4048ddace admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:24.499546 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1350/2713] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:24.503592 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344df554-95d2-4d19-92c6-7ae30e1cb676 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.516870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344df554-95d2-4d19-92c6-7ae30e1cb676 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:24.523098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4ae81-8eb7-4f5b-8795-313e35bfbb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:24.524202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4ae81-8eb7-4f5b-8795-313e35bfbb75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.524710 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4ae81-8eb7-4f5b-8795-313e35bfbb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.524975 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4ae81-8eb7-4f5b-8795-313e35bfbb75 admin admin] PATH_INFO: `/v3/projects/91b7f80a891844e8a7d3c905cc1a2000/users/0fcd66ff25cc4fefb15d041dc0323b74/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.542274 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4ae81-8eb7-4f5b-8795-313e35bfbb75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b7f80a891844e8a7d3c905cc1a2000, user_id=0fcd66ff25cc4fefb15d041dc0323b74, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:24.545070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4ae81-8eb7-4f5b-8795-313e35bfbb75 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:24.565126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1364/2714] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:24 2022] PUT /identity/v3/projects/91b7f80a891844e8a7d3c905cc1a2000/users/0fcd66ff25cc4fefb15d041dc0323b74/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:24.566576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9b17-761e-47fd-aded-98f4048ddace admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.578585 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d9b17-761e-47fd-aded-98f4048ddace admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:24.641219 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbef52-4a7c-4a28-9ab6-019099d6260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:24.641896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbef52-4a7c-4a28-9ab6-019099d6260e admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.642216 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbef52-4a7c-4a28-9ab6-019099d6260e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.642503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbef52-4a7c-4a28-9ab6-019099d6260e admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.643262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbef52-4a7c-4a28-9ab6-019099d6260e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:24.644867 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbef52-4a7c-4a28-9ab6-019099d6260e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:24.654851 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1351/2715] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:24.659020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4ae81-8eb7-4f5b-8795-313e35bfbb75 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.669391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4ae81-8eb7-4f5b-8795-313e35bfbb75 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:24.674164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db35f3-59bb-48cb-930d-ef73a71246d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:24.675079 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db35f3-59bb-48cb-930d-ef73a71246d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.675370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db35f3-59bb-48cb-930d-ef73a71246d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.675653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db35f3-59bb-48cb-930d-ef73a71246d1 admin admin] PATH_INFO: `/v3/projects/91b7f80a891844e8a7d3c905cc1a2000/users/0fcd66ff25cc4fefb15d041dc0323b74/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.677657 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db35f3-59bb-48cb-930d-ef73a71246d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b7f80a891844e8a7d3c905cc1a2000, user_id=0fcd66ff25cc4fefb15d041dc0323b74, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:24.680992 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db35f3-59bb-48cb-930d-ef73a71246d1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:24.691328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1365/2716] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:24 2022] PUT /identity/v3/projects/91b7f80a891844e8a7d3c905cc1a2000/users/0fcd66ff25cc4fefb15d041dc0323b74/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:24.702306 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703615e-386f-4d26-82db-be887c56b41f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.702606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703615e-386f-4d26-82db-be887c56b41f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.702891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703615e-386f-4d26-82db-be887c56b41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.732935 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a703615e-386f-4d26-82db-be887c56b41f None None] MFA Rules not processed for user `0fcd66ff25cc4fefb15d041dc0323b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:24.734184 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a703615e-386f-4d26-82db-be887c56b41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:24.802572 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1352/2717] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:24.814539 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db35f3-59bb-48cb-930d-ef73a71246d1 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:24.816318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-04db35f3-59bb-48cb-930d-ef73a71246d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:24.878107 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db35f3-59bb-48cb-930d-ef73a71246d1 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:24.881762 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6a408-ab33-47ea-a411-869749e0b788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:24.882454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6a408-ab33-47ea-a411-869749e0b788 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:24.882744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6a408-ab33-47ea-a411-869749e0b788 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:24.883075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6a408-ab33-47ea-a411-869749e0b788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:24.892182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6a408-ab33-47ea-a411-869749e0b788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:24.893622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6a408-ab33-47ea-a411-869749e0b788 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:24.903610 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1366/2718] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:25.479119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703615e-386f-4d26-82db-be887c56b41f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:25.542933 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703615e-386f-4d26-82db-be887c56b41f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:25.547486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:25.548346 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.548634 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.548907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] PATH_INFO: `/v3/users/c634379613634eb1931878bcc49f49e3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.550085 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c634379613634eb1931878bcc49f49e3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:25.552021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:25.557197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:25.604432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c634379613634eb1931878bcc49f49e3'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:25.605114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c634379613634eb1931878bcc49f49e3'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:25.605728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c634379613634eb1931878bcc49f49e3'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:25.614109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c634379613634eb1931878bcc49f49e3'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:25.630463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c634379613634eb1931878bcc49f49e3'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:25.646217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1353/2719] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:25 2022] DELETE /identity/v3/users/c634379613634eb1931878bcc49f49e3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:25.651956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d567a-3fc3-4738-a8c1-93aacff1c6ea None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.652466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d567a-3fc3-4738-a8c1-93aacff1c6ea None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.652587 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d567a-3fc3-4738-a8c1-93aacff1c6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.671736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-5d4d567a-3fc3-4738-a8c1-93aacff1c6ea None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:25.673049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5d4d567a-3fc3-4738-a8c1-93aacff1c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:25.690966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:25.738931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1367/2720] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:25.749763 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:25.751196 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:25.811676 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94177bd2-330d-48f2-b94f-eeba27c7518f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:25.815923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f71e9e-4205-41f7-8bb6-8ce85f2d9052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:25.816711 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f71e9e-4205-41f7-8bb6-8ce85f2d9052 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:25.817049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f71e9e-4205-41f7-8bb6-8ce85f2d9052 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:25.817352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f71e9e-4205-41f7-8bb6-8ce85f2d9052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:25.828194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f71e9e-4205-41f7-8bb6-8ce85f2d9052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:25.829652 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f71e9e-4205-41f7-8bb6-8ce85f2d9052 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:25.840071 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1354/2721] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:26.129464 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d567a-3fc3-4738-a8c1-93aacff1c6ea None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:26.131206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-5d4d567a-3fc3-4738-a8c1-93aacff1c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:26.138793 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f71e9e-4205-41f7-8bb6-8ce85f2d9052 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:26.140343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-26f71e9e-4205-41f7-8bb6-8ce85f2d9052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:26.148221 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d567a-3fc3-4738-a8c1-93aacff1c6ea None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:26.153201 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:26.154027 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:26.154355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:26.154643 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] PATH_INFO: `/v3/projects/30e51cacac45455b8c892a8fd50e72e8` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:26.155794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f71e9e-4205-41f7-8bb6-8ce85f2d9052 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:26.155905 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e51cacac45455b8c892a8fd50e72e8)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:26.157858 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:26.160608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e8df4-1014-4367-a936-c694a578974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:26.161518 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8df4-1014-4367-a936-c694a578974f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:26.161741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8df4-1014-4367-a936-c694a578974f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:26.162031 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e8df4-1014-4367-a936-c694a578974f admin admin] PATH_INFO: `/v3/users/090a97c9e79c45afaa6670c0628144cc` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:26.163470 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e8df4-1014-4367-a936-c694a578974f admin admin] RBAC: Authorizing `identity:delete_user(user_id=090a97c9e79c45afaa6670c0628144cc)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:26.165480 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e8df4-1014-4367-a936-c694a578974f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:26.216953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e51cacac45455b8c892a8fd50e72e8', 'request_id': 'req-124215bd-bccb-4587-885e-7aa85e0778f4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.228288 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e51cacac45455b8c892a8fd50e72e8', 'request_id': 'req-124215bd-bccb-4587-885e-7aa85e0778f4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.229495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c44e8df4-1014-4367-a936-c694a578974f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090a97c9e79c45afaa6670c0628144cc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.230270 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c44e8df4-1014-4367-a936-c694a578974f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090a97c9e79c45afaa6670c0628144cc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.230917 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c44e8df4-1014-4367-a936-c694a578974f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090a97c9e79c45afaa6670c0628144cc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.235751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e51cacac45455b8c892a8fd50e72e8', 'request_id': 'req-124215bd-bccb-4587-885e-7aa85e0778f4'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.239721 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c44e8df4-1014-4367-a936-c694a578974f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090a97c9e79c45afaa6670c0628144cc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.249659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] The token cache is being invalidate because project 30e51cacac45455b8c892a8fd50e72e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:26.249956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.250697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.252337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1368/2722] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:26 2022] DELETE /identity/v3/projects/30e51cacac45455b8c892a8fd50e72e8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:26.257565 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:26.258995 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:26.259743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c44e8df4-1014-4367-a936-c694a578974f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090a97c9e79c45afaa6670c0628144cc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.269257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:26.280678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1355/2723] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:26 2022] DELETE /identity/v3/users/090a97c9e79c45afaa6670c0628144cc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:26.282762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2653e-3115-4e8e-815c-fc3f4b678081 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:26.283468 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2653e-3115-4e8e-815c-fc3f4b678081 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:26.284285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2653e-3115-4e8e-815c-fc3f4b678081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:26.302775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4aa2653e-3115-4e8e-815c-fc3f4b678081 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:26.304621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4aa2653e-3115-4e8e-815c-fc3f4b678081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:26.326688 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124215bd-bccb-4587-885e-7aa85e0778f4 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:26.366544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1356/2724] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:26.376702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2653e-3115-4e8e-815c-fc3f4b678081 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:26.378442 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4aa2653e-3115-4e8e-815c-fc3f4b678081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:26.383660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:26.395371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:26.396262 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:26.396553 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:26.396837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] PATH_INFO: `/v3/users/0fcd66ff25cc4fefb15d041dc0323b74` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:26.398876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fcd66ff25cc4fefb15d041dc0323b74)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:26.400815 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:26.439988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2653e-3115-4e8e-815c-fc3f4b678081 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:26.443614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e511a94-2c68-4a8f-8a39-342914de8331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:26.444453 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e511a94-2c68-4a8f-8a39-342914de8331 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:26.444718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e511a94-2c68-4a8f-8a39-342914de8331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:26.444997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e511a94-2c68-4a8f-8a39-342914de8331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:26.451339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fcd66ff25cc4fefb15d041dc0323b74'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.452029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fcd66ff25cc4fefb15d041dc0323b74'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.452662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fcd66ff25cc4fefb15d041dc0323b74'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.454348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e511a94-2c68-4a8f-8a39-342914de8331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:26.455821 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e511a94-2c68-4a8f-8a39-342914de8331 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:26.459686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fcd66ff25cc4fefb15d041dc0323b74'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.466115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1357/2725] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:25:26.467537 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fcd66ff25cc4fefb15d041dc0323b74'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.486746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1369/2726] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:26 2022] DELETE /identity/v3/users/0fcd66ff25cc4fefb15d041dc0323b74 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:26.840349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e511a94-2c68-4a8f-8a39-342914de8331 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:26.843884 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8e511a94-2c68-4a8f-8a39-342914de8331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:26.862113 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e511a94-2c68-4a8f-8a39-342914de8331 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:26.872956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:26.874589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:26.933973 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:26.934877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:26.935161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:26.935437 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] PATH_INFO: `/v3/projects/eec7ab3f78214b829fd26b22111aa4a3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:26.936762 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec7ab3f78214b829fd26b22111aa4a3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:26.938691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:26.961077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cebb85-ca63-40f8-9888-6eb0c247ae8a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:26.965927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:26.966944 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:26.967339 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:26.967616 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] PATH_INFO: `/v3/projects/91b7f80a891844e8a7d3c905cc1a2000` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:26.968958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b7f80a891844e8a7d3c905cc1a2000)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:26.971118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:26.985032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:26.989247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec7ab3f78214b829fd26b22111aa4a3', 'request_id': 'req-d97ea894-0100-48b3-86f4-c1759af112a5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:26.995714 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec7ab3f78214b829fd26b22111aa4a3', 'request_id': 'req-d97ea894-0100-48b3-86f4-c1759af112a5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.003173 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec7ab3f78214b829fd26b22111aa4a3', 'request_id': 'req-d97ea894-0100-48b3-86f4-c1759af112a5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.015088 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] The token cache is being invalidate because project eec7ab3f78214b829fd26b22111aa4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:27.015377 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.016045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.017575 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1358/2727] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:26 2022] DELETE /identity/v3/projects/eec7ab3f78214b829fd26b22111aa4a3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:27.019429 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b7f80a891844e8a7d3c905cc1a2000', 'request_id': 'req-1de963ee-f0da-411f-9d3a-f786241c530e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.021507 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.023908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:27.026949 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b7f80a891844e8a7d3c905cc1a2000', 'request_id': 'req-1de963ee-f0da-411f-9d3a-f786241c530e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.032825 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b7f80a891844e8a7d3c905cc1a2000', 'request_id': 'req-1de963ee-f0da-411f-9d3a-f786241c530e'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.046832 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] The token cache is being invalidate because project 91b7f80a891844e8a7d3c905cc1a2000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:27.047125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.047782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1de963ee-f0da-411f-9d3a-f786241c530e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.049361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1370/2728] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:26 2022] DELETE /identity/v3/projects/91b7f80a891844e8a7d3c905cc1a2000 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:27.054542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90abde-8f2d-4827-9fa5-e080cb84b1b4 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.054833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90abde-8f2d-4827-9fa5-e080cb84b1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.055116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90abde-8f2d-4827-9fa5-e080cb84b1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.062042 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:27.076361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-ca90abde-8f2d-4827-9fa5-e080cb84b1b4 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:27.077958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-ca90abde-8f2d-4827-9fa5-e080cb84b1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:27.093154 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ea894-0100-48b3-86f4-c1759af112a5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.141350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1371/2729] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:27.150039 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310269a-22c6-4ebc-9651-4380772ff434 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.150363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310269a-22c6-4ebc-9651-4380772ff434 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.150648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310269a-22c6-4ebc-9651-4380772ff434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.155425 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.156299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.156589 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.156866 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] PATH_INFO: `/v3/users/520ebb3f48734c1cb614e87caced4b89` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.158098 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=520ebb3f48734c1cb614e87caced4b89)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.160064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.173092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-b310269a-22c6-4ebc-9651-4380772ff434 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:27.174660 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-b310269a-22c6-4ebc-9651-4380772ff434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:27.182899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1372/2730] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:27.187284 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310269a-22c6-4ebc-9651-4380772ff434 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.198483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310269a-22c6-4ebc-9651-4380772ff434 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.203508 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89d8a7-70b4-4a73-81ba-bb64f89f77a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.204212 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89d8a7-70b4-4a73-81ba-bb64f89f77a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.204505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89d8a7-70b4-4a73-81ba-bb64f89f77a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.204814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89d8a7-70b4-4a73-81ba-bb64f89f77a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.205578 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89d8a7-70b4-4a73-81ba-bb64f89f77a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:27.206029 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89d8a7-70b4-4a73-81ba-bb64f89f77a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.207723 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89d8a7-70b4-4a73-81ba-bb64f89f77a1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.211435 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520ebb3f48734c1cb614e87caced4b89'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.212117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520ebb3f48734c1cb614e87caced4b89'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.212787 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520ebb3f48734c1cb614e87caced4b89'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.221545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1373/2731] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:27.221705 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520ebb3f48734c1cb614e87caced4b89'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.226019 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89d8a7-70b4-4a73-81ba-bb64f89f77a1 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.228189 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1a89d8a7-70b4-4a73-81ba-bb64f89f77a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:27.238138 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520ebb3f48734c1cb614e87caced4b89'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.241870 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89d8a7-70b4-4a73-81ba-bb64f89f77a1 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.247745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a2de-8e38-4466-a9c0-10588f011e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.247905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:27.248435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a2de-8e38-4466-a9c0-10588f011e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.248732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a2de-8e38-4466-a9c0-10588f011e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.249055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185a2de-8e38-4466-a9c0-10588f011e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.249957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185a2de-8e38-4466-a9c0-10588f011e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.252124 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185a2de-8e38-4466-a9c0-10588f011e84 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.256967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1359/2732] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:27 2022] DELETE /identity/v3/users/520ebb3f48734c1cb614e87caced4b89 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:27.282023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1374/2733] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:27 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:27.286359 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.353747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb73266-1d5b-465b-8769-9979e7ab7af0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.415657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c4b08-cc79-4f68-aa6c-4732241ac4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.416822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c4b08-cc79-4f68-aa6c-4732241ac4be admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.417117 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c4b08-cc79-4f68-aa6c-4732241ac4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.417432 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c4b08-cc79-4f68-aa6c-4732241ac4be admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.418329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c4b08-cc79-4f68-aa6c-4732241ac4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.420404 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c4b08-cc79-4f68-aa6c-4732241ac4be admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.441393 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1360/2734] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:27 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:27.446901 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a2de-8e38-4466-a9c0-10588f011e84 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.457530 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185a2de-8e38-4466-a9c0-10588f011e84 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.462855 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cd19b-5a56-49ac-a34e-e762102be5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.463528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cd19b-5a56-49ac-a34e-e762102be5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.464341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cd19b-5a56-49ac-a34e-e762102be5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.464341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cd19b-5a56-49ac-a34e-e762102be5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.464841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cd19b-5a56-49ac-a34e-e762102be5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.466576 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cd19b-5a56-49ac-a34e-e762102be5a4 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.477328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1375/2735] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:27.481444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c4b08-cc79-4f68-aa6c-4732241ac4be admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.492525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c4b08-cc79-4f68-aa6c-4732241ac4be admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.497914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cad8b6-56d4-464c-9da8-c725473b8299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.498640 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cad8b6-56d4-464c-9da8-c725473b8299 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.498925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cad8b6-56d4-464c-9da8-c725473b8299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.499204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cad8b6-56d4-464c-9da8-c725473b8299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.499975 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cad8b6-56d4-464c-9da8-c725473b8299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.501613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cad8b6-56d4-464c-9da8-c725473b8299 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.514462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1361/2736] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:27.519926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cd19b-5a56-49ac-a34e-e762102be5a4 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.532996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cd19b-5a56-49ac-a34e-e762102be5a4 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.540900 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0b402-92be-415f-b703-d3b7ed5ccecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.543265 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0b402-92be-415f-b703-d3b7ed5ccecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.543545 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0b402-92be-415f-b703-d3b7ed5ccecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.543919 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0b402-92be-415f-b703-d3b7ed5ccecf admin admin] PATH_INFO: `/v3/projects/dd24e9e62d3348ac8fca4e19efca0930/users/eaae653db755446d985bbe195450f319/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.550962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cad8b6-56d4-464c-9da8-c725473b8299 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.554828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-89cad8b6-56d4-464c-9da8-c725473b8299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:27.568673 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cad8b6-56d4-464c-9da8-c725473b8299 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.573630 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0b402-92be-415f-b703-d3b7ed5ccecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd24e9e62d3348ac8fca4e19efca0930, user_id=eaae653db755446d985bbe195450f319, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.576810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e0b402-92be-415f-b703-d3b7ed5ccecf admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.579079 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.580458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.580923 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.581299 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] PATH_INFO: `/v3/projects/f1123d3214e845f8ac9438be88ce4b29` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.582966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1123d3214e845f8ac9438be88ce4b29)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.585779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.592163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1376/2737] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:27 2022] PUT /identity/v3/projects/dd24e9e62d3348ac8fca4e19efca0930/users/eaae653db755446d985bbe195450f319/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:27.603971 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89782d-cc9f-488e-9c83-2efa68c6a7ae None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.604269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89782d-cc9f-488e-9c83-2efa68c6a7ae None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.604547 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89782d-cc9f-488e-9c83-2efa68c6a7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.635804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-7f89782d-cc9f-488e-9c83-2efa68c6a7ae None None] MFA Rules not processed for user `eaae653db755446d985bbe195450f319`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:27.637183 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7f89782d-cc9f-488e-9c83-2efa68c6a7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:27.645827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1123d3214e845f8ac9438be88ce4b29', 'request_id': 'req-c27ac884-b8dc-46ab-8f40-d124580e55f4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.652312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1123d3214e845f8ac9438be88ce4b29', 'request_id': 'req-c27ac884-b8dc-46ab-8f40-d124580e55f4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.660109 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1123d3214e845f8ac9438be88ce4b29', 'request_id': 'req-c27ac884-b8dc-46ab-8f40-d124580e55f4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.672893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] The token cache is being invalidate because project f1123d3214e845f8ac9438be88ce4b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:27.673403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.674140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c27ac884-b8dc-46ab-8f40-d124580e55f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:27.675902 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1362/2738] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:27 2022] DELETE /identity/v3/projects/f1123d3214e845f8ac9438be88ce4b29 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:27.683300 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f775b-5ad2-482c-9e60-15c787c82fe5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.683671 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f775b-5ad2-482c-9e60-15c787c82fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.683860 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f775b-5ad2-482c-9e60-15c787c82fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.697965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:27.706774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-959f775b-5ad2-482c-9e60-15c787c82fe5 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:27.706961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1377/2739] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:27.708818 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-959f775b-5ad2-482c-9e60-15c787c82fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:27.711414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89782d-cc9f-488e-9c83-2efa68c6a7ae None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.712731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7f89782d-cc9f-488e-9c83-2efa68c6a7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:27.731450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:27.773486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1363/2740] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:27.781329 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89782d-cc9f-488e-9c83-2efa68c6a7ae None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.782433 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff0372-b3ff-4ff0-9882-5fd5847f7eb1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.782726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff0372-b3ff-4ff0-9882-5fd5847f7eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.783005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff0372-b3ff-4ff0-9882-5fd5847f7eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.786103 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6378a5-8119-416b-a6fb-61dd92140f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.786792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6378a5-8119-416b-a6fb-61dd92140f2c admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.787077 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6378a5-8119-416b-a6fb-61dd92140f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.787353 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6378a5-8119-416b-a6fb-61dd92140f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.788676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6378a5-8119-416b-a6fb-61dd92140f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.790843 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6378a5-8119-416b-a6fb-61dd92140f2c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.801089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-62ff0372-b3ff-4ff0-9882-5fd5847f7eb1 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:27.802341 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-62ff0372-b3ff-4ff0-9882-5fd5847f7eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:27.812128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1364/2741] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:27.816403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff0372-b3ff-4ff0-9882-5fd5847f7eb1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.821501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1378/2742] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:27 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:27.825409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6378a5-8119-416b-a6fb-61dd92140f2c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.837791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff0372-b3ff-4ff0-9882-5fd5847f7eb1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.895350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6378a5-8119-416b-a6fb-61dd92140f2c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.896820 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9361ccc-f5da-4659-a649-49005db19417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.897533 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9361ccc-f5da-4659-a649-49005db19417 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.897907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9361ccc-f5da-4659-a649-49005db19417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.898240 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9361ccc-f5da-4659-a649-49005db19417 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.898977 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9361ccc-f5da-4659-a649-49005db19417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:27.899289 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9361ccc-f5da-4659-a649-49005db19417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.900459 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f386be-367f-418d-9d1e-40512d8bf2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.900893 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9361ccc-f5da-4659-a649-49005db19417 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.901141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f386be-367f-418d-9d1e-40512d8bf2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.901433 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f386be-367f-418d-9d1e-40512d8bf2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.901718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f386be-367f-418d-9d1e-40512d8bf2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.902554 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f386be-367f-418d-9d1e-40512d8bf2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.904515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f386be-367f-418d-9d1e-40512d8bf2d7 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.912564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1365/2743] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:27.918050 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9361ccc-f5da-4659-a649-49005db19417 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.926446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1379/2744] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:27 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:27.929211 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9361ccc-f5da-4659-a649-49005db19417 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.931101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f386be-367f-418d-9d1e-40512d8bf2d7 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.934318 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec0406-d2e3-49f0-a4f2-9a150d118f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.935004 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec0406-d2e3-49f0-a4f2-9a150d118f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.935273 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec0406-d2e3-49f0-a4f2-9a150d118f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.935559 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec0406-d2e3-49f0-a4f2-9a150d118f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.936262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec0406-d2e3-49f0-a4f2-9a150d118f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.938197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec0406-d2e3-49f0-a4f2-9a150d118f0c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.941030 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f386be-367f-418d-9d1e-40512d8bf2d7 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:27.946307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8713cf7-bb7a-4ab5-a616-a577522cc296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:27.947414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8713cf7-bb7a-4ab5-a616-a577522cc296 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:27.947414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8713cf7-bb7a-4ab5-a616-a577522cc296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:27.947654 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8713cf7-bb7a-4ab5-a616-a577522cc296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:27.948250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8713cf7-bb7a-4ab5-a616-a577522cc296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:27.950006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8713cf7-bb7a-4ab5-a616-a577522cc296 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:27.962025 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1380/2745] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:27.966319 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8713cf7-bb7a-4ab5-a616-a577522cc296 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.966770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1366/2746] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:27 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:27.970556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec0406-d2e3-49f0-a4f2-9a150d118f0c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:27.977563 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8713cf7-bb7a-4ab5-a616-a577522cc296 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.035217 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec0406-d2e3-49f0-a4f2-9a150d118f0c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.038975 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940f4df-4f31-4ee9-9dff-9810fb909ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.039888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940f4df-4f31-4ee9-9dff-9810fb909ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.040173 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940f4df-4f31-4ee9-9dff-9810fb909ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.040462 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940f4df-4f31-4ee9-9dff-9810fb909ca7 admin admin] PATH_INFO: `/v3/projects/248ed4ab00ea4402b5968852538000c3/users/cbbac3b480da4767ade780919be155fe/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.041024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f8d3b-f8a7-4236-a6a6-dbcc62afb946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.041703 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f8d3b-f8a7-4236-a6a6-dbcc62afb946 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.041993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f8d3b-f8a7-4236-a6a6-dbcc62afb946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.042312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f8d3b-f8a7-4236-a6a6-dbcc62afb946 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.043358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f8d3b-f8a7-4236-a6a6-dbcc62afb946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.045363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f8d3b-f8a7-4236-a6a6-dbcc62afb946 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.057328 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940f4df-4f31-4ee9-9dff-9810fb909ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248ed4ab00ea4402b5968852538000c3, user_id=cbbac3b480da4767ade780919be155fe, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.060454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940f4df-4f31-4ee9-9dff-9810fb909ca7 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.067077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1367/2747] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:27 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:28.071606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f8d3b-f8a7-4236-a6a6-dbcc62afb946 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.075442 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1381/2748] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:27 2022] PUT /identity/v3/projects/248ed4ab00ea4402b5968852538000c3/users/cbbac3b480da4767ade780919be155fe/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:28.076579 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:28.079321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940f4df-4f31-4ee9-9dff-9810fb909ca7 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.083729 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:28.084042 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f8d3b-f8a7-4236-a6a6-dbcc62afb946 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.145622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc56b9-d2d2-48fe-8443-cfd358588371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.146431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc56b9-d2d2-48fe-8443-cfd358588371 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.146718 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc56b9-d2d2-48fe-8443-cfd358588371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.147565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc56b9-d2d2-48fe-8443-cfd358588371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.147849 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940f4df-4f31-4ee9-9dff-9810fb909ca7 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.148397 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc56b9-d2d2-48fe-8443-cfd358588371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.150054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc56b9-d2d2-48fe-8443-cfd358588371 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.153013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee9c5d-16f0-4daa-9572-a26b3e29e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.153696 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee9c5d-16f0-4daa-9572-a26b3e29e13f admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.153991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee9c5d-16f0-4daa-9572-a26b3e29e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.154307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee9c5d-16f0-4daa-9572-a26b3e29e13f admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.155132 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee9c5d-16f0-4daa-9572-a26b3e29e13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.158273 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee9c5d-16f0-4daa-9572-a26b3e29e13f admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.160989 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1368/2749] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:28.166265 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc56b9-d2d2-48fe-8443-cfd358588371 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.178672 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1382/2750] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:28.178894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc56b9-d2d2-48fe-8443-cfd358588371 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.180368 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee9c5d-16f0-4daa-9572-a26b3e29e13f admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.182178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de6b94-3dc1-4b33-8951-a3752e1c98ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.182845 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de6b94-3dc1-4b33-8951-a3752e1c98ef admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.183128 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de6b94-3dc1-4b33-8951-a3752e1c98ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.183403 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de6b94-3dc1-4b33-8951-a3752e1c98ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.184123 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de6b94-3dc1-4b33-8951-a3752e1c98ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.185756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de6b94-3dc1-4b33-8951-a3752e1c98ef admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.190486 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee9c5d-16f0-4daa-9572-a26b3e29e13f admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.201073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46661e7d-8675-4a17-81fb-708c8df33c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.201293 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1369/2751] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:28.201419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46661e7d-8675-4a17-81fb-708c8df33c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.201419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46661e7d-8675-4a17-81fb-708c8df33c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.201419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46661e7d-8675-4a17-81fb-708c8df33c1c admin admin] PATH_INFO: `/v3/projects/248ed4ab00ea4402b5968852538000c3/users/cbbac3b480da4767ade780919be155fe/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.201693 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de6b94-3dc1-4b33-8951-a3752e1c98ef admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.203209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46661e7d-8675-4a17-81fb-708c8df33c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=248ed4ab00ea4402b5968852538000c3, user_id=cbbac3b480da4767ade780919be155fe, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.205904 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46661e7d-8675-4a17-81fb-708c8df33c1c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.211423 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de6b94-3dc1-4b33-8951-a3752e1c98ef admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.218199 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1383/2752] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:28 2022] PUT /identity/v3/projects/248ed4ab00ea4402b5968852538000c3/users/cbbac3b480da4767ade780919be155fe/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:28.228887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a02c0-6dba-4387-895d-f3dc4cba781c None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.229178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a02c0-6dba-4387-895d-f3dc4cba781c None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.229456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a02c0-6dba-4387-895d-f3dc4cba781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.257693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c35a02c0-6dba-4387-895d-f3dc4cba781c None None] MFA Rules not processed for user `cbbac3b480da4767ade780919be155fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:28.258984 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c35a02c0-6dba-4387-895d-f3dc4cba781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:28.270025 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b904540-b513-4dcb-a165-73b3f45fd27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.270960 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b904540-b513-4dcb-a165-73b3f45fd27b admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.271483 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b904540-b513-4dcb-a165-73b3f45fd27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.271608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b904540-b513-4dcb-a165-73b3f45fd27b admin admin] PATH_INFO: `/v3/projects/697a5864cc3944ee8276d02abeaff8f9/users/0628617e885f44e7b2eefbd5293be546/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.286925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b904540-b513-4dcb-a165-73b3f45fd27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=697a5864cc3944ee8276d02abeaff8f9, user_id=0628617e885f44e7b2eefbd5293be546, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.291993 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b904540-b513-4dcb-a165-73b3f45fd27b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.309422 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1370/2753] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:28 2022] PUT /identity/v3/projects/697a5864cc3944ee8276d02abeaff8f9/users/0628617e885f44e7b2eefbd5293be546/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:28.319786 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc71a7-99c3-4ca0-8358-bd767953b832 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.320263 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc71a7-99c3-4ca0-8358-bd767953b832 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.320544 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc71a7-99c3-4ca0-8358-bd767953b832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.329718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1384/2754] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:28.342059 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a02c0-6dba-4387-895d-f3dc4cba781c None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.343659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c35a02c0-6dba-4387-895d-f3dc4cba781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:28.352193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-09bc71a7-99c3-4ca0-8358-bd767953b832 None None] MFA Rules not processed for user `0628617e885f44e7b2eefbd5293be546`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:28.353446 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-09bc71a7-99c3-4ca0-8358-bd767953b832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:28.402679 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a02c0-6dba-4387-895d-f3dc4cba781c None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.420107 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:28.426374 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1371/2755] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:28.431102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:28.431308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc71a7-99c3-4ca0-8358-bd767953b832 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.458648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3496c37-ad88-438f-85e8-6b80afa13839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.459315 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496c37-ad88-438f-85e8-6b80afa13839 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.460205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496c37-ad88-438f-85e8-6b80afa13839 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.460499 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496c37-ad88-438f-85e8-6b80afa13839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.496561 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc71a7-99c3-4ca0-8358-bd767953b832 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.501314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e6933-9833-431d-9083-07f146441774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.501990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e6933-9833-431d-9083-07f146441774 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.502381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e6933-9833-431d-9083-07f146441774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.502811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e6933-9833-431d-9083-07f146441774 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.503538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e6933-9833-431d-9083-07f146441774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.505476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e6933-9833-431d-9083-07f146441774 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.528514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3496c37-ad88-438f-85e8-6b80afa13839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.530209 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3496c37-ad88-438f-85e8-6b80afa13839 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.541976 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1385/2756] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:25:28.548808 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1372/2757] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:28 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:28.549935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3496c37-ad88-438f-85e8-6b80afa13839 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.560505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3496c37-ad88-438f-85e8-6b80afa13839 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.623363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fff5d-ca7d-480c-815b-04d11dc6d682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.624052 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fff5d-ca7d-480c-815b-04d11dc6d682 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.624341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fff5d-ca7d-480c-815b-04d11dc6d682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.624629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fff5d-ca7d-480c-815b-04d11dc6d682 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.625342 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fff5d-ca7d-480c-815b-04d11dc6d682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.627313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fff5d-ca7d-480c-815b-04d11dc6d682 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.633630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e6933-9833-431d-9083-07f146441774 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.652182 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1386/2758] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:28 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:28.656483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fff5d-ca7d-480c-815b-04d11dc6d682 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.667831 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fff5d-ca7d-480c-815b-04d11dc6d682 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.672573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf9fd6-c295-4a60-895d-e8fdf5889985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.673244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf9fd6-c295-4a60-895d-e8fdf5889985 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.673564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf9fd6-c295-4a60-895d-e8fdf5889985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.673844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf9fd6-c295-4a60-895d-e8fdf5889985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.674619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf9fd6-c295-4a60-895d-e8fdf5889985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.676224 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf9fd6-c295-4a60-895d-e8fdf5889985 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.686750 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1387/2759] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:28.690682 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf9fd6-c295-4a60-895d-e8fdf5889985 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.695536 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e6933-9833-431d-9083-07f146441774 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.699352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300205c-45a9-4848-97bc-1bfba9df746a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.700000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300205c-45a9-4848-97bc-1bfba9df746a service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.700281 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300205c-45a9-4848-97bc-1bfba9df746a service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.700554 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300205c-45a9-4848-97bc-1bfba9df746a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.701966 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf9fd6-c295-4a60-895d-e8fdf5889985 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.708730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d75313-3d28-4243-b98b-8f5cea2a4781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.710908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d75313-3d28-4243-b98b-8f5cea2a4781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.711349 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d75313-3d28-4243-b98b-8f5cea2a4781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.711646 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d75313-3d28-4243-b98b-8f5cea2a4781 admin admin] PATH_INFO: `/v3/projects/802512b38ea640439511d9d83336c1d6/users/58aff1c1ac77455da7011b62ceecc1e2/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.728377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d75313-3d28-4243-b98b-8f5cea2a4781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802512b38ea640439511d9d83336c1d6, user_id=58aff1c1ac77455da7011b62ceecc1e2, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.731270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d75313-3d28-4243-b98b-8f5cea2a4781 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.747300 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1388/2760] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:28 2022] PUT /identity/v3/projects/802512b38ea640439511d9d83336c1d6/users/58aff1c1ac77455da7011b62ceecc1e2/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:28.751106 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d75313-3d28-4243-b98b-8f5cea2a4781 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.768166 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300205c-45a9-4848-97bc-1bfba9df746a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.769631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300205c-45a9-4848-97bc-1bfba9df746a service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.780062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1373/2761] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:25:28.786419 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:28.820758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d75313-3d28-4243-b98b-8f5cea2a4781 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.825681 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fa0cb-5568-4ad5-b0ab-506ab6c4d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.826414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa0cb-5568-4ad5-b0ab-506ab6c4d4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.826703 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa0cb-5568-4ad5-b0ab-506ab6c4d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.826988 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa0cb-5568-4ad5-b0ab-506ab6c4d4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.827727 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fa0cb-5568-4ad5-b0ab-506ab6c4d4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.829313 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fa0cb-5568-4ad5-b0ab-506ab6c4d4c7 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.846350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1389/2762] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:28.851285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300205c-45a9-4848-97bc-1bfba9df746a service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:28.862495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300205c-45a9-4848-97bc-1bfba9df746a service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:28.867678 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b97984-b737-415f-9b4f-8010d787d2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:28.868603 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b97984-b737-415f-9b4f-8010d787d2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.868891 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b97984-b737-415f-9b4f-8010d787d2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.869170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b97984-b737-415f-9b4f-8010d787d2d8 admin admin] PATH_INFO: `/v3/projects/802512b38ea640439511d9d83336c1d6/users/58aff1c1ac77455da7011b62ceecc1e2/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.871368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b97984-b737-415f-9b4f-8010d787d2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802512b38ea640439511d9d83336c1d6, user_id=58aff1c1ac77455da7011b62ceecc1e2, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:28.876471 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b97984-b737-415f-9b4f-8010d787d2d8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:28.885608 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1374/2763] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:28 2022] PUT /identity/v3/projects/802512b38ea640439511d9d83336c1d6/users/58aff1c1ac77455da7011b62ceecc1e2/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:28.896002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562fc2-1aec-4a76-a304-c1b51e2e29b7 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:28.896525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562fc2-1aec-4a76-a304-c1b51e2e29b7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:28.896657 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562fc2-1aec-4a76-a304-c1b51e2e29b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:28.926057 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-40562fc2-1aec-4a76-a304-c1b51e2e29b7 None None] MFA Rules not processed for user `58aff1c1ac77455da7011b62ceecc1e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:28.927321 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-40562fc2-1aec-4a76-a304-c1b51e2e29b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.006448 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1390/2764] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:29.017906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b97984-b737-415f-9b4f-8010d787d2d8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.019830 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-81b97984-b737-415f-9b4f-8010d787d2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.053185 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.067535 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40562fc2-1aec-4a76-a304-c1b51e2e29b7 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.082525 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b97984-b737-415f-9b4f-8010d787d2d8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.086854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745c4d8-fb92-4e7a-85ce-9056fc9b00eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.087512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745c4d8-fb92-4e7a-85ce-9056fc9b00eb service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.087800 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745c4d8-fb92-4e7a-85ce-9056fc9b00eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.088081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745c4d8-fb92-4e7a-85ce-9056fc9b00eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.097868 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745c4d8-fb92-4e7a-85ce-9056fc9b00eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.099391 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745c4d8-fb92-4e7a-85ce-9056fc9b00eb service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.112030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1375/2765] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:29.183130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745c4d8-fb92-4e7a-85ce-9056fc9b00eb service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.252692 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745c4d8-fb92-4e7a-85ce-9056fc9b00eb service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.258125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9207049-d2c0-438b-a51b-a879b8cac4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.259037 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207049-d2c0-438b-a51b-a879b8cac4dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.259319 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207049-d2c0-438b-a51b-a879b8cac4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.259597 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207049-d2c0-438b-a51b-a879b8cac4dd admin admin] PATH_INFO: `/v3/users/0628617e885f44e7b2eefbd5293be546` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.260822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9207049-d2c0-438b-a51b-a879b8cac4dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0628617e885f44e7b2eefbd5293be546)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.262799 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9207049-d2c0-438b-a51b-a879b8cac4dd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.270127 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40562fc2-1aec-4a76-a304-c1b51e2e29b7 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.275282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dd8dc-ba2d-4134-831c-d5b84efabc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.276359 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dd8dc-ba2d-4134-831c-d5b84efabc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.276677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dd8dc-ba2d-4134-831c-d5b84efabc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.276982 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dd8dc-ba2d-4134-831c-d5b84efabc04 admin admin] PATH_INFO: `/v3/users/eaae653db755446d985bbe195450f319` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.278263 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dd8dc-ba2d-4134-831c-d5b84efabc04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaae653db755446d985bbe195450f319)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.280247 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dd8dc-ba2d-4134-831c-d5b84efabc04 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.313972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a9207049-d2c0-438b-a51b-a879b8cac4dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0628617e885f44e7b2eefbd5293be546'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:29.314609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a9207049-d2c0-438b-a51b-a879b8cac4dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0628617e885f44e7b2eefbd5293be546'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:29.315242 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a9207049-d2c0-438b-a51b-a879b8cac4dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0628617e885f44e7b2eefbd5293be546'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:29.323750 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a9207049-d2c0-438b-a51b-a879b8cac4dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0628617e885f44e7b2eefbd5293be546'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:29.330421 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a51dd8dc-ba2d-4134-831c-d5b84efabc04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaae653db755446d985bbe195450f319'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:29.331126 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a51dd8dc-ba2d-4134-831c-d5b84efabc04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaae653db755446d985bbe195450f319'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:29.331737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a51dd8dc-ba2d-4134-831c-d5b84efabc04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaae653db755446d985bbe195450f319'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:29.336760 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a9207049-d2c0-438b-a51b-a879b8cac4dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0628617e885f44e7b2eefbd5293be546'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:29.337835 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.340003 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a51dd8dc-ba2d-4134-831c-d5b84efabc04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaae653db755446d985bbe195450f319'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:29.348732 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-a51dd8dc-ba2d-4134-831c-d5b84efabc04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaae653db755446d985bbe195450f319'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:29.353515 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1376/2766] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:29 2022] DELETE /identity/v3/users/0628617e885f44e7b2eefbd5293be546 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:29.357757 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff05d3-c00b-4fa4-9c25-ef49f25ef4ad None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.358062 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff05d3-c00b-4fa4-9c25-ef49f25ef4ad None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.358381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff05d3-c00b-4fa4-9c25-ef49f25ef4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.367246 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1391/2767] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:29 2022] DELETE /identity/v3/users/eaae653db755446d985bbe195450f319 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:29.371463 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60e637-7fbf-432c-b868-59c6801a72a9 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.371763 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60e637-7fbf-432c-b868-59c6801a72a9 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.372051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60e637-7fbf-432c-b868-59c6801a72a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.376906 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5cff05d3-c00b-4fa4-9c25-ef49f25ef4ad None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:29.378140 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5cff05d3-c00b-4fa4-9c25-ef49f25ef4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.390268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-3f60e637-7fbf-432c-b868-59c6801a72a9 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:29.391575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3f60e637-7fbf-432c-b868-59c6801a72a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.423548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:29.440862 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1377/2768] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:29.451661 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff05d3-c00b-4fa4-9c25-ef49f25ef4ad None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.452990 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5cff05d3-c00b-4fa4-9c25-ef49f25ef4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.457436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1392/2769] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:29.469137 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60e637-7fbf-432c-b868-59c6801a72a9 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.471529 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-3f60e637-7fbf-432c-b868-59c6801a72a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.518810 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff05d3-c00b-4fa4-9c25-ef49f25ef4ad None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.523366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d9283-fd20-4ada-9c3c-44269d7862cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.523965 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9283-fd20-4ada-9c3c-44269d7862cd service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.524250 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9283-fd20-4ada-9c3c-44269d7862cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.524535 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9283-fd20-4ada-9c3c-44269d7862cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.535142 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d9283-fd20-4ada-9c3c-44269d7862cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.536610 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d9283-fd20-4ada-9c3c-44269d7862cd service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.536789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60e637-7fbf-432c-b868-59c6801a72a9 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:29.540776 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d460d-ad70-43a6-bd93-9c0c8e47554c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:29.541435 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d460d-ad70-43a6-bd93-9c0c8e47554c service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:29.541731 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d460d-ad70-43a6-bd93-9c0c8e47554c service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:29.542008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d460d-ad70-43a6-bd93-9c0c8e47554c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:29.546696 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1378/2770] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:25:29.551599 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d460d-ad70-43a6-bd93-9c0c8e47554c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:29.553226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d460d-ad70-43a6-bd93-9c0c8e47554c service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:29.563417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1393/2771] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:29.978969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d9283-fd20-4ada-9c3c-44269d7862cd service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:29.981059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-755d9283-fd20-4ada-9c3c-44269d7862cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:29.996244 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d9283-fd20-4ada-9c3c-44269d7862cd service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.001666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.004298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.004298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.004298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] PATH_INFO: `/v3/projects/697a5864cc3944ee8276d02abeaff8f9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.004619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=697a5864cc3944ee8276d02abeaff8f9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.007169 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.017854 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d460d-ad70-43a6-bd93-9c0c8e47554c service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.019489 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-763d460d-ad70-43a6-bd93-9c0c8e47554c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:30.042897 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d460d-ad70-43a6-bd93-9c0c8e47554c service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.052997 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.054741 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.055105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.055461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] PATH_INFO: `/v3/projects/dd24e9e62d3348ac8fca4e19efca0930` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.056942 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd24e9e62d3348ac8fca4e19efca0930)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.059125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.070858 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697a5864cc3944ee8276d02abeaff8f9', 'request_id': 'req-602ea100-b32d-46b1-83a5-c0f87e57cf2d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.076697 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697a5864cc3944ee8276d02abeaff8f9', 'request_id': 'req-602ea100-b32d-46b1-83a5-c0f87e57cf2d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.085733 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697a5864cc3944ee8276d02abeaff8f9', 'request_id': 'req-602ea100-b32d-46b1-83a5-c0f87e57cf2d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.098395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] The token cache is being invalidate because project 697a5864cc3944ee8276d02abeaff8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:30.098694 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.099333 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.101439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1379/2772] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:29 2022] DELETE /identity/v3/projects/697a5864cc3944ee8276d02abeaff8f9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:30.105758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.107449 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:30.113409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd24e9e62d3348ac8fca4e19efca0930', 'request_id': 'req-0282f409-4fc3-4b31-8001-ab395c2138d6'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.120892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd24e9e62d3348ac8fca4e19efca0930', 'request_id': 'req-0282f409-4fc3-4b31-8001-ab395c2138d6'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.126898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd24e9e62d3348ac8fca4e19efca0930', 'request_id': 'req-0282f409-4fc3-4b31-8001-ab395c2138d6'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.135775 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.141206 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] The token cache is being invalidate because project dd24e9e62d3348ac8fca4e19efca0930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:30.141516 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.142793 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.145379 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1394/2773] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:30 2022] DELETE /identity/v3/projects/dd24e9e62d3348ac8fca4e19efca0930 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:30.150455 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.151991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:30.181980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ea100-b32d-46b1-83a5-c0f87e57cf2d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.203331 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.235446 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282f409-4fc3-4b31-8001-ab395c2138d6 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.241369 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.242296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.242564 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.242847 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] PATH_INFO: `/v3/users/cbbac3b480da4767ade780919be155fe` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.244073 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbac3b480da4767ade780919be155fe)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.244368 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.245246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.245532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.245847 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] PATH_INFO: `/v3/users/58aff1c1ac77455da7011b62ceecc1e2` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.246002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.247092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58aff1c1ac77455da7011b62ceecc1e2)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.248997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.293191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbac3b480da4767ade780919be155fe'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.293866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbac3b480da4767ade780919be155fe'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.294484 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbac3b480da4767ade780919be155fe'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.298322 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58aff1c1ac77455da7011b62ceecc1e2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.298984 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58aff1c1ac77455da7011b62ceecc1e2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.299609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58aff1c1ac77455da7011b62ceecc1e2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.301720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbac3b480da4767ade780919be155fe'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.308052 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58aff1c1ac77455da7011b62ceecc1e2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.310954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbac3b480da4767ade780919be155fe'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.321035 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58aff1c1ac77455da7011b62ceecc1e2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.330787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1395/2774] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:30 2022] DELETE /identity/v3/users/cbbac3b480da4767ade780919be155fe => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:30.334769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1380/2775] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:30 2022] DELETE /identity/v3/users/58aff1c1ac77455da7011b62ceecc1e2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:30.648805 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.650493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:30.735051 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948e4f1-e12a-4ba3-af18-b4670ff26772 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.759013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:30.802784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.803709 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.804001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.804286 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] PATH_INFO: `/v3/projects/802512b38ea640439511d9d83336c1d6` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.805514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=802512b38ea640439511d9d83336c1d6)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.807467 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.859978 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802512b38ea640439511d9d83336c1d6', 'request_id': 'req-58d9660a-bc7d-401b-8200-7416dd6dc469'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.868046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802512b38ea640439511d9d83336c1d6', 'request_id': 'req-58d9660a-bc7d-401b-8200-7416dd6dc469'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.868783 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:30.870334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:30.874938 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802512b38ea640439511d9d83336c1d6', 'request_id': 'req-58d9660a-bc7d-401b-8200-7416dd6dc469'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.886207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db684d03-fd7b-4741-b198-148acdf957f1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:30.889998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] The token cache is being invalidate because project 802512b38ea640439511d9d83336c1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:30.890746 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.891165 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-58d9660a-bc7d-401b-8200-7416dd6dc469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:30.893676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1396/2776] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:30 2022] DELETE /identity/v3/projects/802512b38ea640439511d9d83336c1d6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:30.898969 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d73ea-8389-4065-864a-5086f815c4fe None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.899287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d73ea-8389-4065-864a-5086f815c4fe None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.899659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d73ea-8389-4065-864a-5086f815c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.920068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-cc8d73ea-8389-4065-864a-5086f815c4fe None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:30.921282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cc8d73ea-8389-4065-864a-5086f815c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:30.954957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:30.956186 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:30.956504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:30.956817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] PATH_INFO: `/v3/projects/248ed4ab00ea4402b5968852538000c3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:30.958396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=248ed4ab00ea4402b5968852538000c3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:30.961119 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:30.983707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1397/2777] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:31.008626 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.013125 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248ed4ab00ea4402b5968852538000c3', 'request_id': 'req-ebe17a2e-a417-4645-b20f-92a53c13c3fc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:31.020738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248ed4ab00ea4402b5968852538000c3', 'request_id': 'req-ebe17a2e-a417-4645-b20f-92a53c13c3fc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:31.031213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248ed4ab00ea4402b5968852538000c3', 'request_id': 'req-ebe17a2e-a417-4645-b20f-92a53c13c3fc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:31.044362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] The token cache is being invalidate because project 248ed4ab00ea4402b5968852538000c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:31.044651 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:31.045336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ebe17a2e-a417-4645-b20f-92a53c13c3fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:31.047001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1381/2778] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:30 2022] DELETE /identity/v3/projects/248ed4ab00ea4402b5968852538000c3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:31.047214 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34419e9e-887e-42ed-b49d-15c0a2d83808 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.047752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34419e9e-887e-42ed-b49d-15c0a2d83808 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.047752 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34419e9e-887e-42ed-b49d-15c0a2d83808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.052532 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeefd62-f846-45c4-90f5-31419f7f5808 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.052823 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeefd62-f846-45c4-90f5-31419f7f5808 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.053257 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeefd62-f846-45c4-90f5-31419f7f5808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.065629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-34419e9e-887e-42ed-b49d-15c0a2d83808 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:31.066866 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-34419e9e-887e-42ed-b49d-15c0a2d83808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:31.072752 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3aeefd62-f846-45c4-90f5-31419f7f5808 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:31.073958 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3aeefd62-f846-45c4-90f5-31419f7f5808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:31.117617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.133020 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1398/2779] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:31.135854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1382/2780] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:31.137226 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34419e9e-887e-42ed-b49d-15c0a2d83808 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.143297 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f196fd-ec3c-4c47-b959-8802afad4402 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.143598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f196fd-ec3c-4c47-b959-8802afad4402 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.143883 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f196fd-ec3c-4c47-b959-8802afad4402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.146390 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34419e9e-887e-42ed-b49d-15c0a2d83808 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.152004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d7d5b-a495-4a28-8893-b636675f2cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.152699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d7d5b-a495-4a28-8893-b636675f2cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.152983 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d7d5b-a495-4a28-8893-b636675f2cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.153260 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d7d5b-a495-4a28-8893-b636675f2cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.153991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d7d5b-a495-4a28-8893-b636675f2cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80387) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:31.154329 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d7d5b-a495-4a28-8893-b636675f2cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.155957 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d7d5b-a495-4a28-8893-b636675f2cbe admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.163082 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-83f196fd-ec3c-4c47-b959-8802afad4402 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:31.164309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-83f196fd-ec3c-4c47-b959-8802afad4402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:31.168318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1399/2781] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:31.172542 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d7d5b-a495-4a28-8893-b636675f2cbe admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.175873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1383/2782] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:31.180479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f196fd-ec3c-4c47-b959-8802afad4402 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.183759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d7d5b-a495-4a28-8893-b636675f2cbe admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.188585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178213c-409e-463f-ab4f-d1475e1b4bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.189244 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178213c-409e-463f-ab4f-d1475e1b4bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.189526 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178213c-409e-463f-ab4f-d1475e1b4bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.189674 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f196fd-ec3c-4c47-b959-8802afad4402 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.189789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178213c-409e-463f-ab4f-d1475e1b4bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.190515 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178213c-409e-463f-ab4f-d1475e1b4bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.192393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178213c-409e-463f-ab4f-d1475e1b4bc0 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.194924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cee50-a168-468e-8dd1-943e540746d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.195582 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cee50-a168-468e-8dd1-943e540746d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.195865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cee50-a168-468e-8dd1-943e540746d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.196143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cee50-a168-468e-8dd1-943e540746d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.196881 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cee50-a168-468e-8dd1-943e540746d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:31.197188 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cee50-a168-468e-8dd1-943e540746d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.198827 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cee50-a168-468e-8dd1-943e540746d6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.222613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1384/2783] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:31.223901 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cee50-a168-468e-8dd1-943e540746d6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.231908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1400/2784] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/projects => generated 393 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:31.235789 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178213c-409e-463f-ab4f-d1475e1b4bc0 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.237574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cee50-a168-468e-8dd1-943e540746d6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.294370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8b7ff-f5f5-4315-9636-b47cef642bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.295036 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8b7ff-f5f5-4315-9636-b47cef642bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.295316 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8b7ff-f5f5-4315-9636-b47cef642bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.295591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8b7ff-f5f5-4315-9636-b47cef642bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.296287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8b7ff-f5f5-4315-9636-b47cef642bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.298197 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8b7ff-f5f5-4315-9636-b47cef642bf2 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.301409 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178213c-409e-463f-ab4f-d1475e1b4bc0 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.307068 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e88b4-1738-4332-a4e7-3c77af734460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.307361 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e88b4-1738-4332-a4e7-3c77af734460 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.307650 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e88b4-1738-4332-a4e7-3c77af734460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.307931 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e88b4-1738-4332-a4e7-3c77af734460 admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.308631 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e88b4-1738-4332-a4e7-3c77af734460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.310591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e88b4-1738-4332-a4e7-3c77af734460 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.326602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1385/2785] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:31.330598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8b7ff-f5f5-4315-9636-b47cef642bf2 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.332222 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1401/2786] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:31.336082 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e88b4-1738-4332-a4e7-3c77af734460 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.345477 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e88b4-1738-4332-a4e7-3c77af734460 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.374967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.397417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8b7ff-f5f5-4315-9636-b47cef642bf2 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.402268 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43067e8-0625-409f-b56f-fe221ca0535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.402945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43067e8-0625-409f-b56f-fe221ca0535a admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.403234 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43067e8-0625-409f-b56f-fe221ca0535a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.403510 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43067e8-0625-409f-b56f-fe221ca0535a admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.403851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf70d9-c5e0-4a1f-b9a4-3b9694b48337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.404214 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43067e8-0625-409f-b56f-fe221ca0535a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.404528 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf70d9-c5e0-4a1f-b9a4-3b9694b48337 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.404814 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf70d9-c5e0-4a1f-b9a4-3b9694b48337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.405094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf70d9-c5e0-4a1f-b9a4-3b9694b48337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.405833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf70d9-c5e0-4a1f-b9a4-3b9694b48337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.406205 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43067e8-0625-409f-b56f-fe221ca0535a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.407456 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf70d9-c5e0-4a1f-b9a4-3b9694b48337 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.419172 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1402/2787] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:31.424607 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf70d9-c5e0-4a1f-b9a4-3b9694b48337 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.432627 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1386/2788] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:31.433969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43067e8-0625-409f-b56f-fe221ca0535a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.435680 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf70d9-c5e0-4a1f-b9a4-3b9694b48337 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.440611 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e2f23-841f-4cd3-bfa2-b2b3d96250f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.441281 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e2f23-841f-4cd3-bfa2-b2b3d96250f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.441575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e2f23-841f-4cd3-bfa2-b2b3d96250f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.441865 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e2f23-841f-4cd3-bfa2-b2b3d96250f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.442633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e2f23-841f-4cd3-bfa2-b2b3d96250f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.444552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43067e8-0625-409f-b56f-fe221ca0535a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.444796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e2f23-841f-4cd3-bfa2-b2b3d96250f0 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.449596 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59813149-e448-4e85-bb78-d7601b10c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.450287 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813149-e448-4e85-bb78-d7601b10c802 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.450571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813149-e448-4e85-bb78-d7601b10c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.450853 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59813149-e448-4e85-bb78-d7601b10c802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.451567 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59813149-e448-4e85-bb78-d7601b10c802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.453192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59813149-e448-4e85-bb78-d7601b10c802 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.455461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1403/2789] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:31.459447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e2f23-841f-4cd3-bfa2-b2b3d96250f0 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.467242 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1387/2790] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:31.468180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59813149-e448-4e85-bb78-d7601b10c802 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.469386 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e2f23-841f-4cd3-bfa2-b2b3d96250f0 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.474558 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856bea7-7437-41d6-b54b-ea4057bf73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.474985 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856bea7-7437-41d6-b54b-ea4057bf73da admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.475266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856bea7-7437-41d6-b54b-ea4057bf73da admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.475546 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856bea7-7437-41d6-b54b-ea4057bf73da admin admin] PATH_INFO: `/v3/projects/05e0472024ea4a59b0243939dfe37a60/users/3e7858abef534b61bef2471685ce2c09/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.479774 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59813149-e448-4e85-bb78-d7601b10c802 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.484966 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005776ce-d59d-47be-9846-32f9c0adf813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.485672 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005776ce-d59d-47be-9846-32f9c0adf813 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.485970 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005776ce-d59d-47be-9846-32f9c0adf813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.486292 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005776ce-d59d-47be-9846-32f9c0adf813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.486999 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005776ce-d59d-47be-9846-32f9c0adf813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.488602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005776ce-d59d-47be-9846-32f9c0adf813 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.493312 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856bea7-7437-41d6-b54b-ea4057bf73da admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e0472024ea4a59b0243939dfe37a60, user_id=3e7858abef534b61bef2471685ce2c09, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.497792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856bea7-7437-41d6-b54b-ea4057bf73da admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.501861 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1388/2791] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:31.507484 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005776ce-d59d-47be-9846-32f9c0adf813 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.517743 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1404/2792] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:31 2022] PUT /identity/v3/projects/05e0472024ea4a59b0243939dfe37a60/users/3e7858abef534b61bef2471685ce2c09/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:31.518059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005776ce-d59d-47be-9846-32f9c0adf813 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.530790 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0dd46-237e-49b8-bdc2-13cedee509e4 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.531087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0dd46-237e-49b8-bdc2-13cedee509e4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.531371 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0dd46-237e-49b8-bdc2-13cedee509e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.552573 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.563014 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e9d0dd46-237e-49b8-bdc2-13cedee509e4 None None] MFA Rules not processed for user `3e7858abef534b61bef2471685ce2c09`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:31.564425 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e9d0dd46-237e-49b8-bdc2-13cedee509e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:31.585897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210c981-2c0f-4a2c-9b03-e1609e9e6e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.587602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210c981-2c0f-4a2c-9b03-e1609e9e6e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.587735 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210c981-2c0f-4a2c-9b03-e1609e9e6e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.588007 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210c981-2c0f-4a2c-9b03-e1609e9e6e44 admin admin] PATH_INFO: `/v3/projects/47332445bab940c495cb7c4568c5c315/users/8423598c60644919af82bd0280c0c734/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.604087 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210c981-2c0f-4a2c-9b03-e1609e9e6e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47332445bab940c495cb7c4568c5c315, user_id=8423598c60644919af82bd0280c0c734, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.607069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210c981-2c0f-4a2c-9b03-e1609e9e6e44 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.622049 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1389/2793] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:31 2022] PUT /identity/v3/projects/47332445bab940c495cb7c4568c5c315/users/8423598c60644919af82bd0280c0c734/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:31.627309 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1b85-2ed2-4ca0-b4ec-1f1ea9222289 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.627599 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1b85-2ed2-4ca0-b4ec-1f1ea9222289 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.627879 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f1b85-2ed2-4ca0-b4ec-1f1ea9222289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.638736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1405/2794] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:31.643792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0dd46-237e-49b8-bdc2-13cedee509e4 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.647944 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-171f1b85-2ed2-4ca0-b4ec-1f1ea9222289 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:31.649189 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-171f1b85-2ed2-4ca0-b4ec-1f1ea9222289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:31.655135 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0dd46-237e-49b8-bdc2-13cedee509e4 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.715417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1390/2795] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:31.719718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b4cf5-1bd4-4203-9e15-9f0e11c0064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.720387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4cf5-1bd4-4203-9e15-9f0e11c0064c admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.720677 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4cf5-1bd4-4203-9e15-9f0e11c0064c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.720955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4cf5-1bd4-4203-9e15-9f0e11c0064c admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.721792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b4cf5-1bd4-4203-9e15-9f0e11c0064c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.723744 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b4cf5-1bd4-4203-9e15-9f0e11c0064c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.725657 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f1b85-2ed2-4ca0-b4ec-1f1ea9222289 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.727255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-171f1b85-2ed2-4ca0-b4ec-1f1ea9222289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:31.754234 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1406/2796] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:31.758414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b4cf5-1bd4-4203-9e15-9f0e11c0064c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.765246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.794528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f1b85-2ed2-4ca0-b4ec-1f1ea9222289 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.825794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b4cf5-1bd4-4203-9e15-9f0e11c0064c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.830792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0640-f8cf-4229-8c53-aedbbcb99b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.831485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0640-f8cf-4229-8c53-aedbbcb99b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.831956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0640-f8cf-4229-8c53-aedbbcb99b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.833013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0640-f8cf-4229-8c53-aedbbcb99b4c admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.833013 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb0640-f8cf-4229-8c53-aedbbcb99b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.835026 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb0640-f8cf-4229-8c53-aedbbcb99b4c admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.849303 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600e78c-3390-4c2e-a8c5-c3a821fd49de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.850691 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600e78c-3390-4c2e-a8c5-c3a821fd49de service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.851157 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600e78c-3390-4c2e-a8c5-c3a821fd49de service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.851578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600e78c-3390-4c2e-a8c5-c3a821fd49de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.857998 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1407/2797] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:31 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:31.862078 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0640-f8cf-4229-8c53-aedbbcb99b4c admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.863308 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600e78c-3390-4c2e-a8c5-c3a821fd49de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.864785 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600e78c-3390-4c2e-a8c5-c3a821fd49de service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.878019 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1391/2798] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:25:31.887105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0640-f8cf-4229-8c53-aedbbcb99b4c admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.895295 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a05464-9c76-42cb-ab65-dfca6b3b9a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.896156 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05464-9c76-42cb-ab65-dfca6b3b9a40 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.896444 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05464-9c76-42cb-ab65-dfca6b3b9a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.897204 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a05464-9c76-42cb-ab65-dfca6b3b9a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.897954 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a05464-9c76-42cb-ab65-dfca6b3b9a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.899734 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a05464-9c76-42cb-ab65-dfca6b3b9a40 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.911113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1408/2799] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:31.916201 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600e78c-3390-4c2e-a8c5-c3a821fd49de service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.926463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600e78c-3390-4c2e-a8c5-c3a821fd49de service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:31.931348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27156ddb-e4d9-43d6-b034-8b5341e99205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:31.932245 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156ddb-e4d9-43d6-b034-8b5341e99205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:31.932529 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156ddb-e4d9-43d6-b034-8b5341e99205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:31.932850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27156ddb-e4d9-43d6-b034-8b5341e99205 admin admin] PATH_INFO: `/v3/projects/62e4c1db7c8a45c2b0d59657673808e4/users/4fcdcc50821141d2a246bbedc1901086/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:31.948645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27156ddb-e4d9-43d6-b034-8b5341e99205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e4c1db7c8a45c2b0d59657673808e4, user_id=4fcdcc50821141d2a246bbedc1901086, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:31.951439 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27156ddb-e4d9-43d6-b034-8b5341e99205 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:31.966334 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1392/2800] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:31 2022] PUT /identity/v3/projects/62e4c1db7c8a45c2b0d59657673808e4/users/4fcdcc50821141d2a246bbedc1901086/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:31.970423 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a05464-9c76-42cb-ab65-dfca6b3b9a40 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:31.978256 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:31.982736 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a05464-9c76-42cb-ab65-dfca6b3b9a40 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:32.045605 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700fdfb-03b7-4a9b-9061-6d6ea097ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:32.046340 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700fdfb-03b7-4a9b-9061-6d6ea097ab78 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:32.046636 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700fdfb-03b7-4a9b-9061-6d6ea097ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:32.046923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700fdfb-03b7-4a9b-9061-6d6ea097ab78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:32.047667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700fdfb-03b7-4a9b-9061-6d6ea097ab78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:32.049454 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700fdfb-03b7-4a9b-9061-6d6ea097ab78 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:32.063641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1409/2801] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:32.064819 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27156ddb-e4d9-43d6-b034-8b5341e99205 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:32.075395 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27156ddb-e4d9-43d6-b034-8b5341e99205 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:32.080136 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815e66e-5db6-41bd-b745-f59b9115859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:32.081030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815e66e-5db6-41bd-b745-f59b9115859b admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:32.081317 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815e66e-5db6-41bd-b745-f59b9115859b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:32.081598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815e66e-5db6-41bd-b745-f59b9115859b admin admin] PATH_INFO: `/v3/projects/62e4c1db7c8a45c2b0d59657673808e4/users/4fcdcc50821141d2a246bbedc1901086/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:32.083644 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815e66e-5db6-41bd-b745-f59b9115859b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62e4c1db7c8a45c2b0d59657673808e4, user_id=4fcdcc50821141d2a246bbedc1901086, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:32.087088 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815e66e-5db6-41bd-b745-f59b9115859b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:32.098059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1393/2802] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:32 2022] PUT /identity/v3/projects/62e4c1db7c8a45c2b0d59657673808e4/users/4fcdcc50821141d2a246bbedc1901086/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:32.108482 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2f25-edfe-4ff8-94fc-f9c802f20ff4 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:32.109241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2f25-edfe-4ff8-94fc-f9c802f20ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:32.109241 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d2f25-edfe-4ff8-94fc-f9c802f20ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:32.139773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-7c7d2f25-edfe-4ff8-94fc-f9c802f20ff4 None None] MFA Rules not processed for user `4fcdcc50821141d2a246bbedc1901086`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:32.141000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7c7d2f25-edfe-4ff8-94fc-f9c802f20ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:32.235933 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1410/2803] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:32.245386 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815e66e-5db6-41bd-b745-f59b9115859b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:32.247353 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1815e66e-5db6-41bd-b745-f59b9115859b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:32.315897 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815e66e-5db6-41bd-b745-f59b9115859b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:32.319839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636e90d-64e1-480d-86a3-d4787116cf47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:32.320504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e90d-64e1-480d-86a3-d4787116cf47 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:32.320795 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e90d-64e1-480d-86a3-d4787116cf47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:32.321074 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636e90d-64e1-480d-86a3-d4787116cf47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:32.331056 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636e90d-64e1-480d-86a3-d4787116cf47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:32.332605 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636e90d-64e1-480d-86a3-d4787116cf47 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:32.343064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1394/2804] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:32.390845 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d2f25-edfe-4ff8-94fc-f9c802f20ff4 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:32.392619 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-7c7d2f25-edfe-4ff8-94fc-f9c802f20ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:32.405269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d2f25-edfe-4ff8-94fc-f9c802f20ff4 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:32.408977 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dac1b-73d7-4a6a-af7d-3270607634f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:32.409633 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dac1b-73d7-4a6a-af7d-3270607634f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:32.409935 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dac1b-73d7-4a6a-af7d-3270607634f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:32.410227 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dac1b-73d7-4a6a-af7d-3270607634f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:32.469932 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dac1b-73d7-4a6a-af7d-3270607634f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:32.471471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dac1b-73d7-4a6a-af7d-3270607634f7 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:32.481903 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1411/2805] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:36.259005 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a12b1e-d0e3-4cfd-90f1-762de160b26c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.259598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a12b1e-d0e3-4cfd-90f1-762de160b26c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.259598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a12b1e-d0e3-4cfd-90f1-762de160b26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.285076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dac1b-73d7-4a6a-af7d-3270607634f7 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.295564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f5a12b1e-d0e3-4cfd-90f1-762de160b26c None None] MFA Rules not processed for user `8423598c60644919af82bd0280c0c734`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:36.297461 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f5a12b1e-d0e3-4cfd-90f1-762de160b26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:36.315061 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=100 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:36.350122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:36.367632 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dac1b-73d7-4a6a-af7d-3270607634f7 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.372581 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad53bd-3060-486d-883e-5cde983a77ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.373788 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad53bd-3060-486d-883e-5cde983a77ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.374191 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad53bd-3060-486d-883e-5cde983a77ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.374579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad53bd-3060-486d-883e-5cde983a77ec admin admin] PATH_INFO: `/v3/users/3e7858abef534b61bef2471685ce2c09` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.375926 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad53bd-3060-486d-883e-5cde983a77ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7858abef534b61bef2471685ce2c09)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.378047 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad53bd-3060-486d-883e-5cde983a77ec admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.387463 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1395/2806] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:36.392400 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a12b1e-d0e3-4cfd-90f1-762de160b26c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.403758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a12b1e-d0e3-4cfd-90f1-762de160b26c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.410065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78901c8d-ff27-4434-884f-c72f48e51efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.410997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78901c8d-ff27-4434-884f-c72f48e51efc admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.411337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78901c8d-ff27-4434-884f-c72f48e51efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.411565 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78901c8d-ff27-4434-884f-c72f48e51efc admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.412301 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78901c8d-ff27-4434-884f-c72f48e51efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.415364 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78901c8d-ff27-4434-884f-c72f48e51efc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.437220 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1bad53bd-3060-486d-883e-5cde983a77ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7858abef534b61bef2471685ce2c09'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:36.438017 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1bad53bd-3060-486d-883e-5cde983a77ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7858abef534b61bef2471685ce2c09'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:36.438783 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1bad53bd-3060-486d-883e-5cde983a77ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7858abef534b61bef2471685ce2c09'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:36.448045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1396/2807] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:36 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:36.452027 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78901c8d-ff27-4434-884f-c72f48e51efc admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.453167 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1bad53bd-3060-486d-883e-5cde983a77ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7858abef534b61bef2471685ce2c09'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:36.454702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-78901c8d-ff27-4434-884f-c72f48e51efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:36.462791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-1bad53bd-3060-486d-883e-5cde983a77ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7858abef534b61bef2471685ce2c09'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:36.483909 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1412/2808] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:36 2022] DELETE /identity/v3/users/3e7858abef534b61bef2471685ce2c09 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:36.488566 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d3d9-1f4a-4ad0-b0e9-3c566cebc008 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.488862 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d3d9-1f4a-4ad0-b0e9-3c566cebc008 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.489142 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1d3d9-1f4a-4ad0-b0e9-3c566cebc008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.511279 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-c6a1d3d9-1f4a-4ad0-b0e9-3c566cebc008 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:36.512706 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c6a1d3d9-1f4a-4ad0-b0e9-3c566cebc008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:36.529489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78901c8d-ff27-4434-884f-c72f48e51efc admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.580666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1413/2809] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:36.592066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1d3d9-1f4a-4ad0-b0e9-3c566cebc008 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.593730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c6a1d3d9-1f4a-4ad0-b0e9-3c566cebc008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:36.599206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1886d-47ff-4bb1-934d-8c702610b192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.600553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1886d-47ff-4bb1-934d-8c702610b192 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.600842 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1886d-47ff-4bb1-934d-8c702610b192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.601261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1886d-47ff-4bb1-934d-8c702610b192 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.602609 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1886d-47ff-4bb1-934d-8c702610b192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.604677 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f1886d-47ff-4bb1-934d-8c702610b192 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.626106 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1397/2810] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:36 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:36.630392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1886d-47ff-4bb1-934d-8c702610b192 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.645057 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1886d-47ff-4bb1-934d-8c702610b192 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.651574 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b30fe-a445-4275-979c-e5ff20904222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.652651 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b30fe-a445-4275-979c-e5ff20904222 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.652912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b30fe-a445-4275-979c-e5ff20904222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.653476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b30fe-a445-4275-979c-e5ff20904222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.654260 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b30fe-a445-4275-979c-e5ff20904222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.655662 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:36.656578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b30fe-a445-4275-979c-e5ff20904222 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.671311 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1398/2811] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:36.671688 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1d3d9-1f4a-4ad0-b0e9-3c566cebc008 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.675000 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b30fe-a445-4275-979c-e5ff20904222 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.675888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaad830-87fa-4dbd-ad30-6e054f1a5b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.676640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad830-87fa-4dbd-ad30-6e054f1a5b01 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.676939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad830-87fa-4dbd-ad30-6e054f1a5b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.677225 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad830-87fa-4dbd-ad30-6e054f1a5b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.687800 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaad830-87fa-4dbd-ad30-6e054f1a5b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.689350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaad830-87fa-4dbd-ad30-6e054f1a5b01 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.689564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b30fe-a445-4275-979c-e5ff20904222 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.695046 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47478efa-2480-4b28-9b39-33a00faf50a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.695951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47478efa-2480-4b28-9b39-33a00faf50a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.696239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47478efa-2480-4b28-9b39-33a00faf50a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.696522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47478efa-2480-4b28-9b39-33a00faf50a6 admin admin] PATH_INFO: `/v3/projects/46d1f3660aec474382049ec6733339c4/users/3b7ed2d89d7e4dbb88c89b0a543320b2/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.700574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1414/2812] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:25:36.713495 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47478efa-2480-4b28-9b39-33a00faf50a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d1f3660aec474382049ec6733339c4, user_id=3b7ed2d89d7e4dbb88c89b0a543320b2, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.716280 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47478efa-2480-4b28-9b39-33a00faf50a6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.733647 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1399/2813] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:36 2022] PUT /identity/v3/projects/46d1f3660aec474382049ec6733339c4/users/3b7ed2d89d7e4dbb88c89b0a543320b2/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:36.737485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaad830-87fa-4dbd-ad30-6e054f1a5b01 service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.748355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaad830-87fa-4dbd-ad30-6e054f1a5b01 service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.824523 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09818cfd-cd69-4c24-9a09-9a3dd4c58467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.825579 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09818cfd-cd69-4c24-9a09-9a3dd4c58467 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.825977 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09818cfd-cd69-4c24-9a09-9a3dd4c58467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.827471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09818cfd-cd69-4c24-9a09-9a3dd4c58467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.829249 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09818cfd-cd69-4c24-9a09-9a3dd4c58467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.830179 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09818cfd-cd69-4c24-9a09-9a3dd4c58467 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.842355 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1415/2814] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:36.846431 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47478efa-2480-4b28-9b39-33a00faf50a6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:36.857887 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47478efa-2480-4b28-9b39-33a00faf50a6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:36.862695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2536b60-2da9-475f-afff-581656699d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:36.863616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2536b60-2da9-475f-afff-581656699d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:36.863940 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2536b60-2da9-475f-afff-581656699d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:36.864162 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2536b60-2da9-475f-afff-581656699d45 admin admin] PATH_INFO: `/v3/projects/46d1f3660aec474382049ec6733339c4/users/3b7ed2d89d7e4dbb88c89b0a543320b2/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:36.866854 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2536b60-2da9-475f-afff-581656699d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d1f3660aec474382049ec6733339c4, user_id=3b7ed2d89d7e4dbb88c89b0a543320b2, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:36.869509 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2536b60-2da9-475f-afff-581656699d45 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:36.882945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1400/2815] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:36 2022] PUT /identity/v3/projects/46d1f3660aec474382049ec6733339c4/users/3b7ed2d89d7e4dbb88c89b0a543320b2/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:37.008755 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09818cfd-cd69-4c24-9a09-9a3dd4c58467 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:37.010645 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-09818cfd-cd69-4c24-9a09-9a3dd4c58467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:37.025693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09818cfd-cd69-4c24-9a09-9a3dd4c58467 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:37.093215 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:37.094120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:37.094438 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:37.094718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] PATH_INFO: `/v3/projects/05e0472024ea4a59b0243939dfe37a60` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:37.095902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e0472024ea4a59b0243939dfe37a60)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:37.097799 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:37.153302 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e0472024ea4a59b0243939dfe37a60', 'request_id': 'req-c21509f0-00e5-4864-bd30-3ac017bf8931'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.160513 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e0472024ea4a59b0243939dfe37a60', 'request_id': 'req-c21509f0-00e5-4864-bd30-3ac017bf8931'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.169686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e0472024ea4a59b0243939dfe37a60', 'request_id': 'req-c21509f0-00e5-4864-bd30-3ac017bf8931'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.188325 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] The token cache is being invalidate because project 05e0472024ea4a59b0243939dfe37a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:37.189251 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.190792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.194698 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1416/2816] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:37 2022] DELETE /identity/v3/projects/05e0472024ea4a59b0243939dfe37a60 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:37.199357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2536b60-2da9-475f-afff-581656699d45 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:37.204606 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b2536b60-2da9-475f-afff-581656699d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:37.222645 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2536b60-2da9-475f-afff-581656699d45 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:37.230360 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:37.310344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5c4ce-592b-4782-a760-64777aade452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:37.311307 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5c4ce-592b-4782-a760-64777aade452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:37.311631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5c4ce-592b-4782-a760-64777aade452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:37.311983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5c4ce-592b-4782-a760-64777aade452 admin admin] PATH_INFO: `/v3/users/4fcdcc50821141d2a246bbedc1901086` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:37.313249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5c4ce-592b-4782-a760-64777aade452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fcdcc50821141d2a246bbedc1901086)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:37.315466 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5c4ce-592b-4782-a760-64777aade452 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:37.368033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d7e5c4ce-592b-4782-a760-64777aade452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fcdcc50821141d2a246bbedc1901086'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.368850 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d7e5c4ce-592b-4782-a760-64777aade452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fcdcc50821141d2a246bbedc1901086'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.369496 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d7e5c4ce-592b-4782-a760-64777aade452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fcdcc50821141d2a246bbedc1901086'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.377704 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d7e5c4ce-592b-4782-a760-64777aade452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fcdcc50821141d2a246bbedc1901086'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.392895 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d7e5c4ce-592b-4782-a760-64777aade452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fcdcc50821141d2a246bbedc1901086'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.407621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1401/2817] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:37 2022] DELETE /identity/v3/users/4fcdcc50821141d2a246bbedc1901086 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:37.715156 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:37.729250 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21509f0-00e5-4864-bd30-3ac017bf8931 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:37.748404 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:37.811923 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:37.815125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:37.815427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:37.815851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] PATH_INFO: `/v3/projects/62e4c1db7c8a45c2b0d59657673808e4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:37.817527 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=62e4c1db7c8a45c2b0d59657673808e4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:37.822624 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:37.888708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e4c1db7c8a45c2b0d59657673808e4', 'request_id': 'req-e2daa94e-29f1-4489-920a-20145d3ee2dc'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.897493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e4c1db7c8a45c2b0d59657673808e4', 'request_id': 'req-e2daa94e-29f1-4489-920a-20145d3ee2dc'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.903799 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e4c1db7c8a45c2b0d59657673808e4', 'request_id': 'req-e2daa94e-29f1-4489-920a-20145d3ee2dc'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.927322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] The token cache is being invalidate because project 62e4c1db7c8a45c2b0d59657673808e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:37.928012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.929403 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-e2daa94e-29f1-4489-920a-20145d3ee2dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:37.931716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1417/2818] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:37 2022] DELETE /identity/v3/projects/62e4c1db7c8a45c2b0d59657673808e4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:37.936153 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402364fd-5f47-4fc4-8a38-e7ec2a66ac3c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:37.936560 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402364fd-5f47-4fc4-8a38-e7ec2a66ac3c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:37.936784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402364fd-5f47-4fc4-8a38-e7ec2a66ac3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:37.966291 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-402364fd-5f47-4fc4-8a38-e7ec2a66ac3c None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:37.967255 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-402364fd-5f47-4fc4-8a38-e7ec2a66ac3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:38.045017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1402/2819] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:38.054878 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8089bdf-0d97-4caa-8702-90f0c8693d67 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.055653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8089bdf-0d97-4caa-8702-90f0c8693d67 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.055653 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8089bdf-0d97-4caa-8702-90f0c8693d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.076976 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-f8089bdf-0d97-4caa-8702-90f0c8693d67 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:38.078341 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f8089bdf-0d97-4caa-8702-90f0c8693d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:38.091778 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1418/2820] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:38.096613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402364fd-5f47-4fc4-8a38-e7ec2a66ac3c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.110702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402364fd-5f47-4fc4-8a38-e7ec2a66ac3c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.116115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9390c9-0f24-4ea4-9ed7-4c550f268bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.116805 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9390c9-0f24-4ea4-9ed7-4c550f268bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.117092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9390c9-0f24-4ea4-9ed7-4c550f268bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.117370 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9390c9-0f24-4ea4-9ed7-4c550f268bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.118206 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9390c9-0f24-4ea4-9ed7-4c550f268bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:38.118522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9390c9-0f24-4ea4-9ed7-4c550f268bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.120141 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9390c9-0f24-4ea4-9ed7-4c550f268bfd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.133997 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1403/2821] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:38.138479 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8089bdf-0d97-4caa-8702-90f0c8693d67 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.149956 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8089bdf-0d97-4caa-8702-90f0c8693d67 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.156092 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a11e4-29f1-4d6e-94ae-be1ae9071115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.156785 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a11e4-29f1-4d6e-94ae-be1ae9071115 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.157076 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a11e4-29f1-4d6e-94ae-be1ae9071115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.157358 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a11e4-29f1-4d6e-94ae-be1ae9071115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.158112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a11e4-29f1-4d6e-94ae-be1ae9071115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.160118 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a11e4-29f1-4d6e-94ae-be1ae9071115 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.190200 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1419/2822] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:38 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:38.192967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9390c9-0f24-4ea4-9ed7-4c550f268bfd admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.203907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9390c9-0f24-4ea4-9ed7-4c550f268bfd admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.217230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:38.274497 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d2759-89f2-41de-85ab-9e807abc1a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.275202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d2759-89f2-41de-85ab-9e807abc1a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.275490 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d2759-89f2-41de-85ab-9e807abc1a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.275769 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d2759-89f2-41de-85ab-9e807abc1a3d admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.276510 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d2759-89f2-41de-85ab-9e807abc1a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.278610 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d2759-89f2-41de-85ab-9e807abc1a3d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.302409 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1404/2823] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:38 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:38.307794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a11e4-29f1-4d6e-94ae-be1ae9071115 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.319890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a11e4-29f1-4d6e-94ae-be1ae9071115 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.326721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da4bb2-06dc-4e74-9bf4-55b0cf523c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.326721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da4bb2-06dc-4e74-9bf4-55b0cf523c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.326721 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da4bb2-06dc-4e74-9bf4-55b0cf523c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.327414 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da4bb2-06dc-4e74-9bf4-55b0cf523c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.327690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da4bb2-06dc-4e74-9bf4-55b0cf523c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.329296 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da4bb2-06dc-4e74-9bf4-55b0cf523c34 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.344426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1420/2824] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:38.348630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d2759-89f2-41de-85ab-9e807abc1a3d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.360022 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d2759-89f2-41de-85ab-9e807abc1a3d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.366104 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d968a-850d-4790-aa66-761eecde4432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.366912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d968a-850d-4790-aa66-761eecde4432 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.367482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d968a-850d-4790-aa66-761eecde4432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.367482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d968a-850d-4790-aa66-761eecde4432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.368225 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d968a-850d-4790-aa66-761eecde4432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.369856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d968a-850d-4790-aa66-761eecde4432 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.382406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1405/2825] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:38.387551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da4bb2-06dc-4e74-9bf4-55b0cf523c34 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.400120 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da4bb2-06dc-4e74-9bf4-55b0cf523c34 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.404892 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf70f7-1c8f-4270-a51e-92fe62b81df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.405784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf70f7-1c8f-4270-a51e-92fe62b81df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.406205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf70f7-1c8f-4270-a51e-92fe62b81df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.406391 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf70f7-1c8f-4270-a51e-92fe62b81df6 admin admin] PATH_INFO: `/v3/projects/6054acec0b84426281cda256489c1eb6/users/05886b18058440659d9edfc385e2eb75/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.423582 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf70f7-1c8f-4270-a51e-92fe62b81df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6054acec0b84426281cda256489c1eb6, user_id=05886b18058440659d9edfc385e2eb75, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.426500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf70f7-1c8f-4270-a51e-92fe62b81df6 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.443069 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1421/2826] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:38 2022] PUT /identity/v3/projects/6054acec0b84426281cda256489c1eb6/users/05886b18058440659d9edfc385e2eb75/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:38.453791 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b5318-ceaa-4f24-91ea-390f1d86e30b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.454089 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b5318-ceaa-4f24-91ea-390f1d86e30b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.454402 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b5318-ceaa-4f24-91ea-390f1d86e30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.488017 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0b5b5318-ceaa-4f24-91ea-390f1d86e30b None None] MFA Rules not processed for user `05886b18058440659d9edfc385e2eb75`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:38.489362 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0b5b5318-ceaa-4f24-91ea-390f1d86e30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:38.570623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1406/2827] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:38.575202 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf70f7-1c8f-4270-a51e-92fe62b81df6 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.625667 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:38.657351 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf70f7-1c8f-4270-a51e-92fe62b81df6 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.663574 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1a7e8-d712-41e4-9b2f-69a5ee44a037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.664337 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1a7e8-d712-41e4-9b2f-69a5ee44a037 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.664694 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1a7e8-d712-41e4-9b2f-69a5ee44a037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.665071 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1a7e8-d712-41e4-9b2f-69a5ee44a037 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.665898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1a7e8-d712-41e4-9b2f-69a5ee44a037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.669436 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1a7e8-d712-41e4-9b2f-69a5ee44a037 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.703792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1422/2828] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:38 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:38.707937 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b5318-ceaa-4f24-91ea-390f1d86e30b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.721363 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b5318-ceaa-4f24-91ea-390f1d86e30b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.809469 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d873780-b1f9-49a7-886e-7c6d7ed33481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.810528 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873780-b1f9-49a7-886e-7c6d7ed33481 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.811540 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873780-b1f9-49a7-886e-7c6d7ed33481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.811925 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873780-b1f9-49a7-886e-7c6d7ed33481 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.813324 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d873780-b1f9-49a7-886e-7c6d7ed33481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.816114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d873780-b1f9-49a7-886e-7c6d7ed33481 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.845728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1407/2829] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:38 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:38.850461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1a7e8-d712-41e4-9b2f-69a5ee44a037 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.862720 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1a7e8-d712-41e4-9b2f-69a5ee44a037 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.868450 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664355a5-7004-4911-adf0-c64595a89b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.869648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664355a5-7004-4911-adf0-c64595a89b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.869648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664355a5-7004-4911-adf0-c64595a89b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.870035 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664355a5-7004-4911-adf0-c64595a89b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.870536 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664355a5-7004-4911-adf0-c64595a89b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.872087 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664355a5-7004-4911-adf0-c64595a89b60 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.885877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1423/2830] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:38.890194 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d873780-b1f9-49a7-886e-7c6d7ed33481 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.902120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d873780-b1f9-49a7-886e-7c6d7ed33481 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:38.908015 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e89ac-0606-4de4-a3d9-c876200b3ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:38.909032 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e89ac-0606-4de4-a3d9-c876200b3ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:38.909401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e89ac-0606-4de4-a3d9-c876200b3ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:38.909702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e89ac-0606-4de4-a3d9-c876200b3ad2 admin admin] PATH_INFO: `/v3/projects/3f4b24474c054f638814bf6299954940/users/638b61d1420e4742abbb5e33f0924ad1/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:38.923314 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:38.928664 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e89ac-0606-4de4-a3d9-c876200b3ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4b24474c054f638814bf6299954940, user_id=638b61d1420e4742abbb5e33f0924ad1, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:38.932686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e89ac-0606-4de4-a3d9-c876200b3ad2 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:38.952494 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1408/2831] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:38 2022] PUT /identity/v3/projects/3f4b24474c054f638814bf6299954940/users/638b61d1420e4742abbb5e33f0924ad1/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:38.953714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664355a5-7004-4911-adf0-c64595a89b60 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:38.965555 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664355a5-7004-4911-adf0-c64595a89b60 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:39.036154 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0d3a2-b1a4-4f90-b798-33722f77feb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:39.037413 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0d3a2-b1a4-4f90-b798-33722f77feb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.037700 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0d3a2-b1a4-4f90-b798-33722f77feb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.038108 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0d3a2-b1a4-4f90-b798-33722f77feb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.039005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0d3a2-b1a4-4f90-b798-33722f77feb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:39.041266 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0d3a2-b1a4-4f90-b798-33722f77feb2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:39.052387 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1424/2832] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:39.056726 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e89ac-0606-4de4-a3d9-c876200b3ad2 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:39.067312 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e89ac-0606-4de4-a3d9-c876200b3ad2 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:39.075622 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48ff04-ec1c-46af-a634-2887f61ba317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:39.076531 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48ff04-ec1c-46af-a634-2887f61ba317 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.076817 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48ff04-ec1c-46af-a634-2887f61ba317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.077095 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48ff04-ec1c-46af-a634-2887f61ba317 admin admin] PATH_INFO: `/v3/projects/3f4b24474c054f638814bf6299954940/users/638b61d1420e4742abbb5e33f0924ad1/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.079193 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48ff04-ec1c-46af-a634-2887f61ba317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4b24474c054f638814bf6299954940, user_id=638b61d1420e4742abbb5e33f0924ad1, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:39.081930 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48ff04-ec1c-46af-a634-2887f61ba317 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:39.094788 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1409/2833] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:39 2022] PUT /identity/v3/projects/3f4b24474c054f638814bf6299954940/users/638b61d1420e4742abbb5e33f0924ad1/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:39.107383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54705a8-8b3c-41c8-a65a-31cd35cce2b7 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.107674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54705a8-8b3c-41c8-a65a-31cd35cce2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.107950 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54705a8-8b3c-41c8-a65a-31cd35cce2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.139070 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a54705a8-8b3c-41c8-a65a-31cd35cce2b7 None None] MFA Rules not processed for user `638b61d1420e4742abbb5e33f0924ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:39.140318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a54705a8-8b3c-41c8-a65a-31cd35cce2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:39.301796 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1425/2834] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:39.316365 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48ff04-ec1c-46af-a634-2887f61ba317 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:39.319350 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4e48ff04-ec1c-46af-a634-2887f61ba317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:39.445568 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48ff04-ec1c-46af-a634-2887f61ba317 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:39.453598 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ae76a-6554-413e-90e0-6f43880462f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:39.456731 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ae76a-6554-413e-90e0-6f43880462f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:39.457758 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ae76a-6554-413e-90e0-6f43880462f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:39.458591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ae76a-6554-413e-90e0-6f43880462f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:39.485828 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ae76a-6554-413e-90e0-6f43880462f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:39.488076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ae76a-6554-413e-90e0-6f43880462f1 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:39.536951 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1410/2835] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:40.221380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54705a8-8b3c-41c8-a65a-31cd35cce2b7 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:40.267268 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:40.298543 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54705a8-8b3c-41c8-a65a-31cd35cce2b7 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:40.306023 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:40.306965 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:40.307254 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:40.307531 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] PATH_INFO: `/v3/users/05886b18058440659d9edfc385e2eb75` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:40.313307 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05886b18058440659d9edfc385e2eb75)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:40.315333 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:40.438602 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05886b18058440659d9edfc385e2eb75'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:40.439111 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05886b18058440659d9edfc385e2eb75'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:40.440112 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05886b18058440659d9edfc385e2eb75'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:40.453006 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05886b18058440659d9edfc385e2eb75'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:40.468282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05886b18058440659d9edfc385e2eb75'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:40.553500 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1426/2836] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:40 2022] DELETE /identity/v3/users/05886b18058440659d9edfc385e2eb75 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:40.557654 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056093b-830c-4bcc-b9f1-888195209529 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:40.558646 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056093b-830c-4bcc-b9f1-888195209529 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:40.559040 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056093b-830c-4bcc-b9f1-888195209529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:40.590401 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6056093b-830c-4bcc-b9f1-888195209529 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:40.592067 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6056093b-830c-4bcc-b9f1-888195209529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:40.745080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1411/2837] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:40.752819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:40.754663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:40.872872 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e498db-3c4c-44d3-a109-206f02a84d01 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:40.878823 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510521b-fd7a-48ce-a15c-c72eb4898e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:40.880718 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510521b-fd7a-48ce-a15c-c72eb4898e8b service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:40.881115 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510521b-fd7a-48ce-a15c-c72eb4898e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:40.881501 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510521b-fd7a-48ce-a15c-c72eb4898e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:40.902075 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510521b-fd7a-48ce-a15c-c72eb4898e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:40.903690 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b510521b-fd7a-48ce-a15c-c72eb4898e8b service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:40.926622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1427/2838] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:41.513811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056093b-830c-4bcc-b9f1-888195209529 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:41.515611 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6056093b-830c-4bcc-b9f1-888195209529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:41.539855 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056093b-830c-4bcc-b9f1-888195209529 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:41.546033 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:41.547038 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:41.547327 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:41.547702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] PATH_INFO: `/v3/projects/6054acec0b84426281cda256489c1eb6` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:41.549069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6054acec0b84426281cda256489c1eb6)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:41.551262 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:41.654104 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6054acec0b84426281cda256489c1eb6', 'request_id': 'req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:41.666537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6054acec0b84426281cda256489c1eb6', 'request_id': 'req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:41.688011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6054acec0b84426281cda256489c1eb6', 'request_id': 'req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:41.721749 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] The token cache is being invalidate because project 6054acec0b84426281cda256489c1eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:41.722120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:41.725238 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf325c31-fa9b-4c2d-b4ad-e73147bd6db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:41.728207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1412/2839] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:41 2022] DELETE /identity/v3/projects/6054acec0b84426281cda256489c1eb6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:41.732275 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510521b-fd7a-48ce-a15c-c72eb4898e8b service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:41.756367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510521b-fd7a-48ce-a15c-c72eb4898e8b service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:41.848655 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:41.857049 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:41.858505 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:41.859161 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:41.860493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] PATH_INFO: `/v3/users/638b61d1420e4742abbb5e33f0924ad1` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:41.862064 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=638b61d1420e4742abbb5e33f0924ad1)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:41.864632 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:41.973888 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638b61d1420e4742abbb5e33f0924ad1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:41.975318 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638b61d1420e4742abbb5e33f0924ad1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:41.976096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638b61d1420e4742abbb5e33f0924ad1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:41.999267 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638b61d1420e4742abbb5e33f0924ad1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:42.016844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638b61d1420e4742abbb5e33f0924ad1'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:42.063833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1428/2840] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:41 2022] DELETE /identity/v3/users/638b61d1420e4742abbb5e33f0924ad1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:42.284838 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e00ee-9441-4192-a52b-ef34f89108c3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.285345 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e00ee-9441-4192-a52b-ef34f89108c3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.285806 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e00ee-9441-4192-a52b-ef34f89108c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.292242 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:42.326047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3b6e00ee-9441-4192-a52b-ef34f89108c3 None None] MFA Rules not processed for user `3b7ed2d89d7e4dbb88c89b0a543320b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:42.327344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3b6e00ee-9441-4192-a52b-ef34f89108c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:42.449026 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1413/2841] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:42.460272 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:42.461890 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:42.552083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e00ee-9441-4192-a52b-ef34f89108c3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:42.555273 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3b6e00ee-9441-4192-a52b-ef34f89108c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:42.595094 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbe5ed-4633-4485-b61e-04c880ae33b6 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:42.600877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e68b1b-3eee-46c3-9ee4-a88bc4697fe0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '690a93a4d6ed4666a607b05a8c2b6549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:42.604663 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e68b1b-3eee-46c3-9ee4-a88bc4697fe0 service glance] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.605270 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e68b1b-3eee-46c3-9ee4-a88bc4697fe0 service glance] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.605558 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e68b1b-3eee-46c3-9ee4-a88bc4697fe0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.607829 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-76e68b1b-3eee-46c3-9ee4-a88bc4697fe0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:42.668241 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e00ee-9441-4192-a52b-ef34f89108c3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:42.682340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:42.683650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.684320 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.684728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] PATH_INFO: `/v3/projects/3f4b24474c054f638814bf6299954940` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.686283 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4b24474c054f638814bf6299954940)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:42.688834 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:42.691439 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e68b1b-3eee-46c3-9ee4-a88bc4697fe0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:42.694406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e68b1b-3eee-46c3-9ee4-a88bc4697fe0 service glance] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:42.709908 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1429/2842] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:42.786396 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4b24474c054f638814bf6299954940', 'request_id': 'req-1045785c-4149-4ee8-9a0b-6414ac974904'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:42.800962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4b24474c054f638814bf6299954940', 'request_id': 'req-1045785c-4149-4ee8-9a0b-6414ac974904'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:42.812127 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4b24474c054f638814bf6299954940', 'request_id': 'req-1045785c-4149-4ee8-9a0b-6414ac974904'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:42.837905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] The token cache is being invalidate because project 3f4b24474c054f638814bf6299954940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:42.838367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:42.839135 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1045785c-4149-4ee8-9a0b-6414ac974904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:42.844366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1414/2843] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:42 2022] DELETE /identity/v3/projects/3f4b24474c054f638814bf6299954940 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:42.846759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b140c-4cd0-4b47-9731-9ff84ebc1bf6 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.847287 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b140c-4cd0-4b47-9731-9ff84ebc1bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.847447 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b140c-4cd0-4b47-9731-9ff84ebc1bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.871819 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-d55b140c-4cd0-4b47-9731-9ff84ebc1bf6 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:42.875462 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f9db2-2e2d-467f-adeb-2c49fef12303 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.875641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-d55b140c-4cd0-4b47-9731-9ff84ebc1bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:42.875759 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f9db2-2e2d-467f-adeb-2c49fef12303 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.876413 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f9db2-2e2d-467f-adeb-2c49fef12303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:42.891967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:42.914246 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d36f9db2-2e2d-467f-adeb-2c49fef12303 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:42.915415 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d36f9db2-2e2d-467f-adeb-2c49fef12303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:42.932736 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:42.977730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1430/2844] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:42.981885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916de94-66cb-4670-b5d7-83a520bca5f0 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:42.982228 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916de94-66cb-4670-b5d7-83a520bca5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:42.982517 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916de94-66cb-4670-b5d7-83a520bca5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.006506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e916de94-66cb-4670-b5d7-83a520bca5f0 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:43.007751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e916de94-66cb-4670-b5d7-83a520bca5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:43.012849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1415/2845] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:43.016794 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1431/2846] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:43.020928 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f9db2-2e2d-467f-adeb-2c49fef12303 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.032643 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f9db2-2e2d-467f-adeb-2c49fef12303 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.039120 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f26749-10f4-41cb-8c20-27ce82dabad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.039805 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f26749-10f4-41cb-8c20-27ce82dabad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.040096 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f26749-10f4-41cb-8c20-27ce82dabad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.040380 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f26749-10f4-41cb-8c20-27ce82dabad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.041380 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f26749-10f4-41cb-8c20-27ce82dabad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:43.041481 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f26749-10f4-41cb-8c20-27ce82dabad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.043243 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f26749-10f4-41cb-8c20-27ce82dabad8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.061161 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1416/2847] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 11 14:25:43.062427 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916de94-66cb-4670-b5d7-83a520bca5f0 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.069158 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f26749-10f4-41cb-8c20-27ce82dabad8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.071230 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b8f26749-10f4-41cb-8c20-27ce82dabad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:43.072538 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916de94-66cb-4670-b5d7-83a520bca5f0 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.081426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd72722-7555-4124-a334-2d412c6d0ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.082113 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd72722-7555-4124-a334-2d412c6d0ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.082601 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd72722-7555-4124-a334-2d412c6d0ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.082887 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd72722-7555-4124-a334-2d412c6d0ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.083629 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd72722-7555-4124-a334-2d412c6d0ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.087000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd72722-7555-4124-a334-2d412c6d0ee5 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.118240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1432/2848] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:43.120889 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd72722-7555-4124-a334-2d412c6d0ee5 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.160956 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f26749-10f4-41cb-8c20-27ce82dabad8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.188686 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd72722-7555-4124-a334-2d412c6d0ee5 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.193557 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063abbd-c651-42aa-98fc-cbd8b0aef67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.194426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063abbd-c651-42aa-98fc-cbd8b0aef67a admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.194714 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063abbd-c651-42aa-98fc-cbd8b0aef67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.194991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063abbd-c651-42aa-98fc-cbd8b0aef67a admin admin] PATH_INFO: `/v3/users` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.195688 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063abbd-c651-42aa-98fc-cbd8b0aef67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.197638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063abbd-c651-42aa-98fc-cbd8b0aef67a admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.222584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1433/2849] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:43.225849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6ec47-49d5-4cdc-b680-45b9177413aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.226537 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6ec47-49d5-4cdc-b680-45b9177413aa service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.226822 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6ec47-49d5-4cdc-b680-45b9177413aa service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.227101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6ec47-49d5-4cdc-b680-45b9177413aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.228298 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063abbd-c651-42aa-98fc-cbd8b0aef67a admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.238178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063abbd-c651-42aa-98fc-cbd8b0aef67a admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.243350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb52c06-895d-420c-b443-ed685a449e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.244021 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb52c06-895d-420c-b443-ed685a449e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.244311 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb52c06-895d-420c-b443-ed685a449e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.244591 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb52c06-895d-420c-b443-ed685a449e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.245326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb52c06-895d-420c-b443-ed685a449e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.246961 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb52c06-895d-420c-b443-ed685a449e69 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.260881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1434/2850] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:43.261943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb52c06-895d-420c-b443-ed685a449e69 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.272092 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.272352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb52c06-895d-420c-b443-ed685a449e69 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.277366 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba04d5-d832-4369-97de-09a811b10631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.278034 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba04d5-d832-4369-97de-09a811b10631 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.278348 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba04d5-d832-4369-97de-09a811b10631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.278638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba04d5-d832-4369-97de-09a811b10631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.279363 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba04d5-d832-4369-97de-09a811b10631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.281072 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba04d5-d832-4369-97de-09a811b10631 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.288811 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6ec47-49d5-4cdc-b680-45b9177413aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.290451 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6ec47-49d5-4cdc-b680-45b9177413aa service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.295786 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1435/2851] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:43.296773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba04d5-d832-4369-97de-09a811b10631 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.299235 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1417/2852] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 11 14:25:43.307001 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba04d5-d832-4369-97de-09a811b10631 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.311708 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb609e-8c41-4ef0-b9cd-dafbc66e1434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.312594 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb609e-8c41-4ef0-b9cd-dafbc66e1434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.312945 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb609e-8c41-4ef0-b9cd-dafbc66e1434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.313138 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb609e-8c41-4ef0-b9cd-dafbc66e1434 admin admin] PATH_INFO: `/v3/projects/773284fab53645edbf81f1fd0d0216b0/users/ed1deb8f8aec48918b0fb0c832fe7814/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.332326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb609e-8c41-4ef0-b9cd-dafbc66e1434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773284fab53645edbf81f1fd0d0216b0, user_id=ed1deb8f8aec48918b0fb0c832fe7814, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.335841 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb609e-8c41-4ef0-b9cd-dafbc66e1434 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.358283 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1436/2853] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:43 2022] PUT /identity/v3/projects/773284fab53645edbf81f1fd0d0216b0/users/ed1deb8f8aec48918b0fb0c832fe7814/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:43.369336 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8983aa4-59a8-46bd-8996-3a168b692ec9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.369621 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8983aa4-59a8-46bd-8996-3a168b692ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.369914 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8983aa4-59a8-46bd-8996-3a168b692ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.406946 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d8983aa4-59a8-46bd-8996-3a168b692ec9 None None] MFA Rules not processed for user `ed1deb8f8aec48918b0fb0c832fe7814`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:43.408208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d8983aa4-59a8-46bd-8996-3a168b692ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:43.493619 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1418/2854] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:43.498149 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb609e-8c41-4ef0-b9cd-dafbc66e1434 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.539356 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:43.591205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb609e-8c41-4ef0-b9cd-dafbc66e1434 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.596492 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b885906-9d75-44e5-ad90-8b2951d42682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.597181 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b885906-9d75-44e5-ad90-8b2951d42682 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.597470 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b885906-9d75-44e5-ad90-8b2951d42682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.597751 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b885906-9d75-44e5-ad90-8b2951d42682 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.598596 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b885906-9d75-44e5-ad90-8b2951d42682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.601046 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b885906-9d75-44e5-ad90-8b2951d42682 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.635765 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1437/2855] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:43.640578 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8983aa4-59a8-46bd-8996-3a168b692ec9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.660253 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8983aa4-59a8-46bd-8996-3a168b692ec9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.740839 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6fa8f-0190-4a4e-93de-1c201b4b0fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.742406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6fa8f-0190-4a4e-93de-1c201b4b0fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.742865 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6fa8f-0190-4a4e-93de-1c201b4b0fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.743353 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6fa8f-0190-4a4e-93de-1c201b4b0fcb admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.744146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6fa8f-0190-4a4e-93de-1c201b4b0fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.746786 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6fa8f-0190-4a4e-93de-1c201b4b0fcb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.782204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1419/2856] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:43 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:43.785162 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b885906-9d75-44e5-ad90-8b2951d42682 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.799237 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b885906-9d75-44e5-ad90-8b2951d42682 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.804468 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2647-0c3f-4581-89f9-2ee8f7f53331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.805170 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2647-0c3f-4581-89f9-2ee8f7f53331 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.805461 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2647-0c3f-4581-89f9-2ee8f7f53331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.805927 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2647-0c3f-4581-89f9-2ee8f7f53331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.808962 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2647-0c3f-4581-89f9-2ee8f7f53331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.811263 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2647-0c3f-4581-89f9-2ee8f7f53331 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.824507 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1438/2857] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 11 14:25:43.830468 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6fa8f-0190-4a4e-93de-1c201b4b0fcb admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.846349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6fa8f-0190-4a4e-93de-1c201b4b0fcb admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:43.852011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c25f05-61f7-4feb-8410-73e9f8ed9638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:43.853064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c25f05-61f7-4feb-8410-73e9f8ed9638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:43.853358 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c25f05-61f7-4feb-8410-73e9f8ed9638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:43.853642 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c25f05-61f7-4feb-8410-73e9f8ed9638 admin admin] PATH_INFO: `/v3/projects/3e2122c4df7045f4b6bbac52e1e8226f/users/6839cb94b3f14e2ebe7bbd584e62a757/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:43.872371 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c25f05-61f7-4feb-8410-73e9f8ed9638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2122c4df7045f4b6bbac52e1e8226f, user_id=6839cb94b3f14e2ebe7bbd584e62a757, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:43.874226 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c25f05-61f7-4feb-8410-73e9f8ed9638 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:43.894775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1420/2858] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:43 2022] PUT /identity/v3/projects/3e2122c4df7045f4b6bbac52e1e8226f/users/6839cb94b3f14e2ebe7bbd584e62a757/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:43.896759 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2647-0c3f-4581-89f9-2ee8f7f53331 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:43.909940 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2647-0c3f-4581-89f9-2ee8f7f53331 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.002707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411d09c-482c-4d39-b880-811b593385e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.003323 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d09c-482c-4d39-b880-811b593385e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.003617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d09c-482c-4d39-b880-811b593385e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.003902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411d09c-482c-4d39-b880-811b593385e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.004665 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411d09c-482c-4d39-b880-811b593385e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.007146 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411d09c-482c-4d39-b880-811b593385e1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.026200 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1439/2859] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:44.027738 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c25f05-61f7-4feb-8410-73e9f8ed9638 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.049595 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c25f05-61f7-4feb-8410-73e9f8ed9638 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.063100 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dd2c2-9652-4d8d-871e-63508ea995c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.064519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dd2c2-9652-4d8d-871e-63508ea995c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.064519 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dd2c2-9652-4d8d-871e-63508ea995c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.064734 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dd2c2-9652-4d8d-871e-63508ea995c7 admin admin] PATH_INFO: `/v3/projects/3e2122c4df7045f4b6bbac52e1e8226f/users/6839cb94b3f14e2ebe7bbd584e62a757/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.070337 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dd2c2-9652-4d8d-871e-63508ea995c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2122c4df7045f4b6bbac52e1e8226f, user_id=6839cb94b3f14e2ebe7bbd584e62a757, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.073344 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dd2c2-9652-4d8d-871e-63508ea995c7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.090212 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1421/2860] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:44 2022] PUT /identity/v3/projects/3e2122c4df7045f4b6bbac52e1e8226f/users/6839cb94b3f14e2ebe7bbd584e62a757/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:44.100008 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd90f8-a035-4cac-a821-d19dc2098b78 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.100383 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd90f8-a035-4cac-a821-d19dc2098b78 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.100649 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd90f8-a035-4cac-a821-d19dc2098b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.140806 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-cadd90f8-a035-4cac-a821-d19dc2098b78 None None] MFA Rules not processed for user `6839cb94b3f14e2ebe7bbd584e62a757`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:44.142605 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cadd90f8-a035-4cac-a821-d19dc2098b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:44.261164 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1440/2861] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:44.273988 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dd2c2-9652-4d8d-871e-63508ea995c7 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:44.276047 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-447dd2c2-9652-4d8d-871e-63508ea995c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:44.321780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:44.374556 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dd2c2-9652-4d8d-871e-63508ea995c7 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:44.379465 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feacb52-abd7-4698-bda1-f2e183ad199c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:44.380367 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feacb52-abd7-4698-bda1-f2e183ad199c service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:44.380796 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feacb52-abd7-4698-bda1-f2e183ad199c service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:44.381083 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feacb52-abd7-4698-bda1-f2e183ad199c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:44.462919 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feacb52-abd7-4698-bda1-f2e183ad199c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:44.464454 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feacb52-abd7-4698-bda1-f2e183ad199c service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:44.482924 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1422/2862] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:49.288093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd90f8-a035-4cac-a821-d19dc2098b78 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:49.289596 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cadd90f8-a035-4cac-a821-d19dc2098b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:49.305753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd90f8-a035-4cac-a821-d19dc2098b78 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:49.309782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be2588-4993-4887-be5f-5a919e92b5b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:49.310483 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be2588-4993-4887-be5f-5a919e92b5b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:49.311375 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be2588-4993-4887-be5f-5a919e92b5b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:49.311753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be2588-4993-4887-be5f-5a919e92b5b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:49.324967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be2588-4993-4887-be5f-5a919e92b5b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:49.326449 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be2588-4993-4887-be5f-5a919e92b5b7 service cinder] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:49.340393 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1441/2863] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:52.542552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833fe17-e31c-4047-b896-b74aafd280e0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.543054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833fe17-e31c-4047-b896-b74aafd280e0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.543180 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833fe17-e31c-4047-b896-b74aafd280e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.562145 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8833fe17-e31c-4047-b896-b74aafd280e0 None None] MFA Rules not processed for user `8423598c60644919af82bd0280c0c734`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:52.563392 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8833fe17-e31c-4047-b896-b74aafd280e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:52.619615 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1423/2864] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:52.875488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be2588-4993-4887-be5f-5a919e92b5b7 service cinder] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:52.876911 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-59be2588-4993-4887-be5f-5a919e92b5b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:52.887697 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:52.936043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be2588-4993-4887-be5f-5a919e92b5b7 service cinder] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:52.939567 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd029c-fc3b-44f8-af0c-76108c6cc212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:52.940219 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd029c-fc3b-44f8-af0c-76108c6cc212 service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:52.940804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd029c-fc3b-44f8-af0c-76108c6cc212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:52.940804 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd029c-fc3b-44f8-af0c-76108c6cc212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:52.942753 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-9cdd029c-fc3b-44f8-af0c-76108c6cc212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:52.952382 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd029c-fc3b-44f8-af0c-76108c6cc212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:52.953810 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd029c-fc3b-44f8-af0c-76108c6cc212 service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:52.963876 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1442/2865] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:54.337631 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833fe17-e31c-4047-b896-b74aafd280e0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:54.399907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833fe17-e31c-4047-b896-b74aafd280e0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:54.404680 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:54.405557 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.405843 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.406124 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] PATH_INFO: `/v3/users/ed1deb8f8aec48918b0fb0c832fe7814` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.407399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed1deb8f8aec48918b0fb0c832fe7814)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:54.409326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:54.438464 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:54.457724 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed1deb8f8aec48918b0fb0c832fe7814'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:54.458904 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed1deb8f8aec48918b0fb0c832fe7814'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:54.459505 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed1deb8f8aec48918b0fb0c832fe7814'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:54.466547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed1deb8f8aec48918b0fb0c832fe7814'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:54.480321 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed1deb8f8aec48918b0fb0c832fe7814'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:54.500737 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1424/2866] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:54 2022] DELETE /identity/v3/users/ed1deb8f8aec48918b0fb0c832fe7814 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:54.506552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5664cce-227e-4392-8413-d1e9bf9e0cbf None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.507129 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5664cce-227e-4392-8413-d1e9bf9e0cbf None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.507575 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5664cce-227e-4392-8413-d1e9bf9e0cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.530380 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-e5664cce-227e-4392-8413-d1e9bf9e0cbf None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:54.531621 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-e5664cce-227e-4392-8413-d1e9bf9e0cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:54.618943 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1443/2867] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:54.629522 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:54.631361 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:54.717009 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49417d27-ebfb-4e39-bf80-a0427cd3e517 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:54.723080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44a1f4-a8fd-40fa-8fd7-15bbd63028ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:54.725151 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44a1f4-a8fd-40fa-8fd7-15bbd63028ff service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.725504 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44a1f4-a8fd-40fa-8fd7-15bbd63028ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.725873 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44a1f4-a8fd-40fa-8fd7-15bbd63028ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.736539 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44a1f4-a8fd-40fa-8fd7-15bbd63028ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:54.737985 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44a1f4-a8fd-40fa-8fd7-15bbd63028ff service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:54.750239 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1425/2868] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:25:54.933178 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b88d18-dd10-4de7-8a29-fd412d0bf437 None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:54.933522 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b88d18-dd10-4de7-8a29-fd412d0bf437 None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:54.933824 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b88d18-dd10-4de7-8a29-fd412d0bf437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:54.952401 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-a1b88d18-dd10-4de7-8a29-fd412d0bf437 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:54.953639 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a1b88d18-dd10-4de7-8a29-fd412d0bf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:55.030285 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1444/2869] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Jul 11 14:25:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:55.046352 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44a1f4-a8fd-40fa-8fd7-15bbd63028ff service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.048143 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9b44a1f4-a8fd-40fa-8fd7-15bbd63028ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:55.065952 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b88d18-dd10-4de7-8a29-fd412d0bf437 None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.067525 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-a1b88d18-dd10-4de7-8a29-fd412d0bf437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:55.090894 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b88d18-dd10-4de7-8a29-fd412d0bf437 None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.097738 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.099787 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.100240 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.101493 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] PATH_INFO: `/v3/projects/773284fab53645edbf81f1fd0d0216b0` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.104561 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=773284fab53645edbf81f1fd0d0216b0)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:55.108953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:55.137751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44a1f4-a8fd-40fa-8fd7-15bbd63028ff service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.147261 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3504b9-708d-43a5-9771-8fdd93be06c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.147500 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3504b9-708d-43a5-9771-8fdd93be06c9 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.147754 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3504b9-708d-43a5-9771-8fdd93be06c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.148101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3504b9-708d-43a5-9771-8fdd93be06c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.157479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3504b9-708d-43a5-9771-8fdd93be06c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:55.160784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3504b9-708d-43a5-9771-8fdd93be06c9 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:55.162217 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773284fab53645edbf81f1fd0d0216b0', 'request_id': 'req-884b6a5d-7322-46a0-9d7c-5006cf5dd569'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:55.164992 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:55.170117 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773284fab53645edbf81f1fd0d0216b0', 'request_id': 'req-884b6a5d-7322-46a0-9d7c-5006cf5dd569'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:55.171591 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1426/2870] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:25:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:25:55.184064 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773284fab53645edbf81f1fd0d0216b0', 'request_id': 'req-884b6a5d-7322-46a0-9d7c-5006cf5dd569'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:55.201953 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] The token cache is being invalidate because project 773284fab53645edbf81f1fd0d0216b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:55.202350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:55.203102 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:55.204941 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1445/2871] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:55 2022] DELETE /identity/v3/projects/773284fab53645edbf81f1fd0d0216b0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:55.209618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3504b9-708d-43a5-9771-8fdd93be06c9 service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.225048 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3504b9-708d-43a5-9771-8fdd93be06c9 service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:55.267011 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:55.326852 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364d635-754c-431a-b096-68775c397d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:55.328436 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364d635-754c-431a-b096-68775c397d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:55.328972 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364d635-754c-431a-b096-68775c397d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:55.329298 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364d635-754c-431a-b096-68775c397d1d admin admin] PATH_INFO: `/v3/users/6839cb94b3f14e2ebe7bbd584e62a757` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:55.334616 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364d635-754c-431a-b096-68775c397d1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6839cb94b3f14e2ebe7bbd584e62a757)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:55.346146 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364d635-754c-431a-b096-68775c397d1d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:55.438709 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b364d635-754c-431a-b096-68775c397d1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6839cb94b3f14e2ebe7bbd584e62a757'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:55.439381 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b364d635-754c-431a-b096-68775c397d1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6839cb94b3f14e2ebe7bbd584e62a757'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:55.445849 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b364d635-754c-431a-b096-68775c397d1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6839cb94b3f14e2ebe7bbd584e62a757'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:55.456503 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b364d635-754c-431a-b096-68775c397d1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6839cb94b3f14e2ebe7bbd584e62a757'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:55.477216 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b364d635-754c-431a-b096-68775c397d1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6839cb94b3f14e2ebe7bbd584e62a757'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:55.515030 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1427/2872] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:25:55 2022] DELETE /identity/v3/users/6839cb94b3f14e2ebe7bbd584e62a757 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:55.928105 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:55.932524 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:55.957322 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b6a5d-7322-46a0-9d7c-5006cf5dd569 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.043647 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.044781 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.045370 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.045676 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] PATH_INFO: `/v3/projects/3e2122c4df7045f4b6bbac52e1e8226f` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.048782 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2122c4df7045f4b6bbac52e1e8226f)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.053916 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.144415 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2122c4df7045f4b6bbac52e1e8226f', 'request_id': 'req-2a116d5d-c213-4e52-a53f-7775c29663e2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:56.152177 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2122c4df7045f4b6bbac52e1e8226f', 'request_id': 'req-2a116d5d-c213-4e52-a53f-7775c29663e2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:56.165758 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2122c4df7045f4b6bbac52e1e8226f', 'request_id': 'req-2a116d5d-c213-4e52-a53f-7775c29663e2'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:56.190585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] The token cache is being invalidate because project 3e2122c4df7045f4b6bbac52e1e8226f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:25:56.191310 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:56.193552 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-2a116d5d-c213-4e52-a53f-7775c29663e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:25:56.201098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1446/2873] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:25:55 2022] DELETE /identity/v3/projects/3e2122c4df7045f4b6bbac52e1e8226f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:56.202489 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad029fc7-bca5-43f6-b9af-946e9763b1c9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.202780 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad029fc7-bca5-43f6-b9af-946e9763b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.203059 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad029fc7-bca5-43f6-b9af-946e9763b1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.226349 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ad029fc7-bca5-43f6-b9af-946e9763b1c9 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:56.227976 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ad029fc7-bca5-43f6-b9af-946e9763b1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:56.316564 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1428/2874] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:56.319282 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b06fb-df2f-418e-970a-cd969f18676a None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.319583 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b06fb-df2f-418e-970a-cd969f18676a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.319885 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b06fb-df2f-418e-970a-cd969f18676a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.339031 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-893b06fb-df2f-418e-970a-cd969f18676a None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:56.340289 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-893b06fb-df2f-418e-970a-cd969f18676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:56.349098 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1447/2875] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:56.353506 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad029fc7-bca5-43f6-b9af-946e9763b1c9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.365934 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad029fc7-bca5-43f6-b9af-946e9763b1c9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.370962 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae9e46-c3e6-4cc1-aea7-4d08d7af7325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.371779 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae9e46-c3e6-4cc1-aea7-4d08d7af7325 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.372077 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae9e46-c3e6-4cc1-aea7-4d08d7af7325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.372357 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae9e46-c3e6-4cc1-aea7-4d08d7af7325 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.373103 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae9e46-c3e6-4cc1-aea7-4d08d7af7325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 11 14:25:56.373417 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae9e46-c3e6-4cc1-aea7-4d08d7af7325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.375081 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae9e46-c3e6-4cc1-aea7-4d08d7af7325 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.390467 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1429/2876] 10.222.0.66 () {58 vars in 1152 bytes} [Mon Jul 11 14:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 11 14:25:56.395012 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b06fb-df2f-418e-970a-cd969f18676a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.406293 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b06fb-df2f-418e-970a-cd969f18676a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.412511 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bfca4-bb2a-4651-99e6-d4453d3e5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.413269 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bfca4-bb2a-4651-99e6-d4453d3e5efa admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.413632 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bfca4-bb2a-4651-99e6-d4453d3e5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.413991 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bfca4-bb2a-4651-99e6-d4453d3e5efa admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.414813 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bfca4-bb2a-4651-99e6-d4453d3e5efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.416827 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bfca4-bb2a-4651-99e6-d4453d3e5efa admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.461664 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1448/2877] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:56 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:56.462130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae9e46-c3e6-4cc1-aea7-4d08d7af7325 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.473894 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae9e46-c3e6-4cc1-aea7-4d08d7af7325 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.532207 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:56.555274 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9a0b-01a9-4a74-a737-be15e7212237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.555982 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9a0b-01a9-4a74-a737-be15e7212237 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.556285 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9a0b-01a9-4a74-a737-be15e7212237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.556633 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9a0b-01a9-4a74-a737-be15e7212237 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.557348 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede9a0b-01a9-4a74-a737-be15e7212237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.559476 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede9a0b-01a9-4a74-a737-be15e7212237 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.588630 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1430/2878] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:56 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:56.589833 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bfca4-bb2a-4651-99e6-d4453d3e5efa admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.607551 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bfca4-bb2a-4651-99e6-d4453d3e5efa admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.612472 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42272d-ad95-42e3-969e-f4f71dee3596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.613163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42272d-ad95-42e3-969e-f4f71dee3596 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.613452 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42272d-ad95-42e3-969e-f4f71dee3596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.613730 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42272d-ad95-42e3-969e-f4f71dee3596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.615828 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42272d-ad95-42e3-969e-f4f71dee3596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.617707 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42272d-ad95-42e3-969e-f4f71dee3596 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.629101 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1449/2879] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:56.635512 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9a0b-01a9-4a74-a737-be15e7212237 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.648458 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9a0b-01a9-4a74-a737-be15e7212237 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.653675 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb475624-f824-49f9-821e-92eaab47fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.654406 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475624-f824-49f9-821e-92eaab47fc72 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.654932 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475624-f824-49f9-821e-92eaab47fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.655218 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb475624-f824-49f9-821e-92eaab47fc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.656122 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb475624-f824-49f9-821e-92eaab47fc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.657765 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb475624-f824-49f9-821e-92eaab47fc72 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.670174 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1431/2880] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:56.674412 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42272d-ad95-42e3-969e-f4f71dee3596 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.685973 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42272d-ad95-42e3-969e-f4f71dee3596 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.691385 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2024b-bbd4-41e7-8dd8-f4e94fd0d18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.692495 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2024b-bbd4-41e7-8dd8-f4e94fd0d18d admin admin] REQUEST_METHOD: `PUT` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.692846 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2024b-bbd4-41e7-8dd8-f4e94fd0d18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.693195 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2024b-bbd4-41e7-8dd8-f4e94fd0d18d admin admin] PATH_INFO: `/v3/projects/9818ffa436f9476984dacdaff30b10d2/users/93e5fdd842aa44bb8362baf39298a9fd/roles/8b1dade745704cf3a2a92b5ac07853b4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.711613 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2024b-bbd4-41e7-8dd8-f4e94fd0d18d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9818ffa436f9476984dacdaff30b10d2, user_id=93e5fdd842aa44bb8362baf39298a9fd, role_id=8b1dade745704cf3a2a92b5ac07853b4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.714550 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2024b-bbd4-41e7-8dd8-f4e94fd0d18d admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.730656 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1450/2881] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:56 2022] PUT /identity/v3/projects/9818ffa436f9476984dacdaff30b10d2/users/93e5fdd842aa44bb8362baf39298a9fd/roles/8b1dade745704cf3a2a92b5ac07853b4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:25:56.743836 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580a633-ab0f-43f5-b59c-488281354371 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.744187 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580a633-ab0f-43f5-b59c-488281354371 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.744477 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580a633-ab0f-43f5-b59c-488281354371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.773831 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e580a633-ab0f-43f5-b59c-488281354371 None None] MFA Rules not processed for user `93e5fdd842aa44bb8362baf39298a9fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:56.775290 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e580a633-ab0f-43f5-b59c-488281354371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:56.853775 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1432/2882] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 11 14:25:56.858495 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2024b-bbd4-41e7-8dd8-f4e94fd0d18d admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.868213 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:56.932143 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2024b-bbd4-41e7-8dd8-f4e94fd0d18d admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:56.936921 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06985d1c-24e8-4162-83a8-c60c221aa186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:56.937589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06985d1c-24e8-4162-83a8-c60c221aa186 admin admin] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:56.937871 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06985d1c-24e8-4162-83a8-c60c221aa186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:56.938144 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06985d1c-24e8-4162-83a8-c60c221aa186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:56.938877 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06985d1c-24e8-4162-83a8-c60c221aa186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:56.940784 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06985d1c-24e8-4162-83a8-c60c221aa186 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:56.976641 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1451/2883] 10.222.0.66 () {60 vars in 1152 bytes} [Mon Jul 11 14:25:56 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 11 14:25:56.980980 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580a633-ab0f-43f5-b59c-488281354371 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:56.994144 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580a633-ab0f-43f5-b59c-488281354371 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.058148 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0078a3-da02-4e70-a20d-1e4d29383c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:57.059258 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0078a3-da02-4e70-a20d-1e4d29383c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.059741 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0078a3-da02-4e70-a20d-1e4d29383c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.060234 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0078a3-da02-4e70-a20d-1e4d29383c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.060878 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0078a3-da02-4e70-a20d-1e4d29383c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:57.063070 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0078a3-da02-4e70-a20d-1e4d29383c48 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:57.094442 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1433/2884] 10.222.0.66 () {60 vars in 1143 bytes} [Mon Jul 11 14:25:56 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 11 14:25:57.096739 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06985d1c-24e8-4162-83a8-c60c221aa186 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:57.109615 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06985d1c-24e8-4162-83a8-c60c221aa186 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.115936 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7404d4b-932f-4bd8-84cd-d23488e28ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:57.116683 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7404d4b-932f-4bd8-84cd-d23488e28ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.117000 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7404d4b-932f-4bd8-84cd-d23488e28ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.117248 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7404d4b-932f-4bd8-84cd-d23488e28ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.118005 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7404d4b-932f-4bd8-84cd-d23488e28ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:57.119674 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7404d4b-932f-4bd8-84cd-d23488e28ee9 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:57.132687 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1452/2885] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:57.138198 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0078a3-da02-4e70-a20d-1e4d29383c48 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:57.150921 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0078a3-da02-4e70-a20d-1e4d29383c48 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.156547 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd6419-eae8-4e2e-b7c9-58591e070bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:57.157576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd6419-eae8-4e2e-b7c9-58591e070bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.157967 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd6419-eae8-4e2e-b7c9-58591e070bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.158382 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd6419-eae8-4e2e-b7c9-58591e070bd7 admin admin] PATH_INFO: `/v3/projects/cd84ef73100945b5a87b851c69fad0c5/users/b7b6ad0d7fa44312a1caa7f882fa2b88/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.178399 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd6419-eae8-4e2e-b7c9-58591e070bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd84ef73100945b5a87b851c69fad0c5, user_id=b7b6ad0d7fa44312a1caa7f882fa2b88, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:57.181571 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd6419-eae8-4e2e-b7c9-58591e070bd7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:57.204908 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1434/2886] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:57 2022] PUT /identity/v3/projects/cd84ef73100945b5a87b851c69fad0c5/users/b7b6ad0d7fa44312a1caa7f882fa2b88/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:57.214889 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7404d4b-932f-4bd8-84cd-d23488e28ee9 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:57.227488 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7404d4b-932f-4bd8-84cd-d23488e28ee9 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.315821 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb18df-9e6b-4604-8275-0e832c798ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:57.316519 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb18df-9e6b-4604-8275-0e832c798ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.316808 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb18df-9e6b-4604-8275-0e832c798ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.317617 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb18df-9e6b-4604-8275-0e832c798ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.318418 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb18df-9e6b-4604-8275-0e832c798ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:57.320037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb18df-9e6b-4604-8275-0e832c798ff5 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:57.332305 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1453/2887] 10.222.0.66 () {58 vars in 1121 bytes} [Mon Jul 11 14:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 11 14:25:57.336650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd6419-eae8-4e2e-b7c9-58591e070bd7 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:57.347303 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd6419-eae8-4e2e-b7c9-58591e070bd7 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.352905 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feb49e-8aac-4cca-9e25-8f8c3dbe587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:57.353583 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb49e-8aac-4cca-9e25-8f8c3dbe587d admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.354247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb49e-8aac-4cca-9e25-8f8c3dbe587d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.354247 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feb49e-8aac-4cca-9e25-8f8c3dbe587d admin admin] PATH_INFO: `/v3/projects/cd84ef73100945b5a87b851c69fad0c5/users/b7b6ad0d7fa44312a1caa7f882fa2b88/roles/57f1335a97b5490cb0853894c2faf62c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.364065 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feb49e-8aac-4cca-9e25-8f8c3dbe587d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd84ef73100945b5a87b851c69fad0c5, user_id=b7b6ad0d7fa44312a1caa7f882fa2b88, role_id=57f1335a97b5490cb0853894c2faf62c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:57.368426 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73feb49e-8aac-4cca-9e25-8f8c3dbe587d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:57.382784 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1435/2888] 10.222.0.66 () {60 vars in 1482 bytes} [Mon Jul 11 14:25:57 2022] PUT /identity/v3/projects/cd84ef73100945b5a87b851c69fad0c5/users/b7b6ad0d7fa44312a1caa7f882fa2b88/roles/57f1335a97b5490cb0853894c2faf62c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:25:57.397811 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b942c56-90ac-4e79-8924-83270b2d757a None None] REQUEST_METHOD: `POST` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.398093 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b942c56-90ac-4e79-8924-83270b2d757a None None] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.398417 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b942c56-90ac-4e79-8924-83270b2d757a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.434548 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.auth.core [None req-6b942c56-90ac-4e79-8924-83270b2d757a None None] MFA Rules not processed for user `b7b6ad0d7fa44312a1caa7f882fa2b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80387) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:25:57.436096 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6b942c56-90ac-4e79-8924-83270b2d757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:57.523253 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1454/2889] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:25:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:25:57.534695 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feb49e-8aac-4cca-9e25-8f8c3dbe587d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:25:57.536558 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-73feb49e-8aac-4cca-9e25-8f8c3dbe587d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:25:57.542318 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:25:57.605623 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73feb49e-8aac-4cca-9e25-8f8c3dbe587d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:25:57.610021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1239d5c-a72f-4d01-8cdc-9a411f57633c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5cf559c8a69483ca7625f37d5931439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:25:57.610722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239d5c-a72f-4d01-8cdc-9a411f57633c service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:25:57.611018 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239d5c-a72f-4d01-8cdc-9a411f57633c service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:25:57.611305 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1239d5c-a72f-4d01-8cdc-9a411f57633c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:25:57.684044 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1239d5c-a72f-4d01-8cdc-9a411f57633c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:25:57.685538 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1239d5c-a72f-4d01-8cdc-9a411f57633c service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:25:57.697114 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1436/2890] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:25:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:26:00.336377 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b942c56-90ac-4e79-8924-83270b2d757a None None] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:00.341053 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:00.438271 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b942c56-90ac-4e79-8924-83270b2d757a None None] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:00.452745 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:00.453981 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.455851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.455851 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] PATH_INFO: `/v3/users/93e5fdd842aa44bb8362baf39298a9fd` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.456673 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e5fdd842aa44bb8362baf39298a9fd)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:00.459329 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:00.527737 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e5fdd842aa44bb8362baf39298a9fd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:00.528466 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e5fdd842aa44bb8362baf39298a9fd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:00.529141 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e5fdd842aa44bb8362baf39298a9fd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:00.541066 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e5fdd842aa44bb8362baf39298a9fd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:00.552644 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e5fdd842aa44bb8362baf39298a9fd'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:00.576352 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1455/2891] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:26:00 2022] DELETE /identity/v3/users/93e5fdd842aa44bb8362baf39298a9fd => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:00.582054 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159a9c5-fa0c-4899-bcba-ef8039909d42 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.582756 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159a9c5-fa0c-4899-bcba-ef8039909d42 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.583204 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159a9c5-fa0c-4899-bcba-ef8039909d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.605776 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f159a9c5-fa0c-4899-bcba-ef8039909d42 None None] MFA Rules not processed for user `477dddd95e9e4c9dab1e4c703d6c3e08`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:26:00.607101 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f159a9c5-fa0c-4899-bcba-ef8039909d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:00.700213 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1437/2892] 10.222.0.66 () {58 vars in 957 bytes} [Mon Jul 11 14:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:26:00.712326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:00.714406 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:00.822706 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4d6c5-374e-40fc-9d40-12c2c12f48e1 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:00.827604 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e05025-424b-4121-81b5-7e6dc191f27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:00.828402 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05025-424b-4121-81b5-7e6dc191f27b service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:00.828699 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05025-424b-4121-81b5-7e6dc191f27b service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:00.828987 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e05025-424b-4121-81b5-7e6dc191f27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:00.847506 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e05025-424b-4121-81b5-7e6dc191f27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:00.850771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e05025-424b-4121-81b5-7e6dc191f27b service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:00.869584 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1456/2893] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:26:01.250877 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159a9c5-fa0c-4899-bcba-ef8039909d42 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:01.252428 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f159a9c5-fa0c-4899-bcba-ef8039909d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:01.267770 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159a9c5-fa0c-4899-bcba-ef8039909d42 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:01.277279 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:01.278384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.278666 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.278945 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] PATH_INFO: `/v3/projects/9818ffa436f9476984dacdaff30b10d2` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.280889 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9818ffa436f9476984dacdaff30b10d2)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:01.283553 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:01.355366 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9818ffa436f9476984dacdaff30b10d2', 'request_id': 'req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:01.357600 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:01.366794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9818ffa436f9476984dacdaff30b10d2', 'request_id': 'req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:01.377713 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9818ffa436f9476984dacdaff30b10d2', 'request_id': 'req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:01.394178 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] The token cache is being invalidate because project 9818ffa436f9476984dacdaff30b10d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:26:01.394479 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:01.395907 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:01.397548 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1438/2894] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:26:01 2022] DELETE /identity/v3/projects/9818ffa436f9476984dacdaff30b10d2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:01.401792 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e05025-424b-4121-81b5-7e6dc191f27b service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:01.421638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e05025-424b-4121-81b5-7e6dc191f27b service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:01.445261 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:01.493929 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:01.495367 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:01.495666 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:01.495958 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] PATH_INFO: `/v3/users/b7b6ad0d7fa44312a1caa7f882fa2b88` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:01.497350 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b6ad0d7fa44312a1caa7f882fa2b88)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:01.499791 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:01.554899 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b6ad0d7fa44312a1caa7f882fa2b88'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:01.555880 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b6ad0d7fa44312a1caa7f882fa2b88'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:01.556585 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b6ad0d7fa44312a1caa7f882fa2b88'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:01.564151 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b6ad0d7fa44312a1caa7f882fa2b88'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:01.573196 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b6ad0d7fa44312a1caa7f882fa2b88'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:01.599064 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1457/2895] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:26:01 2022] DELETE /identity/v3/users/b7b6ad0d7fa44312a1caa7f882fa2b88 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:01.913566 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:01.915132 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:01.929356 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2022f4a-e2cb-43dc-9dd5-f7f5b09bc10c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:02.023020 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:02.023913 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:02.024202 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:02.024482 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] PATH_INFO: `/v3/projects/cd84ef73100945b5a87b851c69fad0c5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:02.025722 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd84ef73100945b5a87b851c69fad0c5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:02.027702 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:02.086452 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd84ef73100945b5a87b851c69fad0c5', 'request_id': 'req-746cf981-4eee-4f5d-9844-b8e100f345e8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:02.101115 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd84ef73100945b5a87b851c69fad0c5', 'request_id': 'req-746cf981-4eee-4f5d-9844-b8e100f345e8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:02.110848 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd84ef73100945b5a87b851c69fad0c5', 'request_id': 'req-746cf981-4eee-4f5d-9844-b8e100f345e8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:02.123045 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] The token cache is being invalidate because project cd84ef73100945b5a87b851c69fad0c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:26:02.123340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:02.124001 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:26:02.125686 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1439/2896] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:26:01 2022] DELETE /identity/v3/projects/cd84ef73100945b5a87b851c69fad0c5 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:26:11.593518 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:12.119777 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:19.473281 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:19.474771 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:19.533207 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2e92-9bbd-45f4-8318-bdaadb4f9df9 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:19.581898 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c2c3a-0c7c-45e9-93c6-8bb5f23a3f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4426582f945e4c90bf8debd2ecbd9769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:19.582589 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c2c3a-0c7c-45e9-93c6-8bb5f23a3f8f service neutron] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:19.582881 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c2c3a-0c7c-45e9-93c6-8bb5f23a3f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:19.583163 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c2c3a-0c7c-45e9-93c6-8bb5f23a3f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:19.585648 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c88c2c3a-0c7c-45e9-93c6-8bb5f23a3f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:19.658569 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c2c3a-0c7c-45e9-93c6-8bb5f23a3f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:19.660002 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c2c3a-0c7c-45e9-93c6-8bb5f23a3f8f service neutron] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:19.670867 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1458/2897] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:26:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:26:21.516130 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:26:21.518116 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:21.612442 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cf981-4eee-4f5d-9844-b8e100f345e8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:26:21.620069 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91cf50-a8d9-45bc-9dc6-dcccedea5c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a31386700941c9b103720a64bac405', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:26:21.620747 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91cf50-a8d9-45bc-9dc6-dcccedea5c84 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:26:21.621043 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91cf50-a8d9-45bc-9dc6-dcccedea5c84 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:26:21.621329 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91cf50-a8d9-45bc-9dc6-dcccedea5c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:26:21.623602 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1e91cf50-a8d9-45bc-9dc6-dcccedea5c84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:26:21.636876 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91cf50-a8d9-45bc-9dc6-dcccedea5c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:26:21.638590 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91cf50-a8d9-45bc-9dc6-dcccedea5c84 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:26:21.650486 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1440/2898] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:26:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 11 14:26:29.666235 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=70 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:26:31.645294 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=34 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:27.489595 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c2c3a-0c7c-45e9-93c6-8bb5f23a3f8f service neutron] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:27.491043 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-c88c2c3a-0c7c-45e9-93c6-8bb5f23a3f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:27.558939 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c2c3a-0c7c-45e9-93c6-8bb5f23a3f8f service neutron] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:27.563967 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0f92d-3961-41ac-af89-920f32eebffe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:27.564624 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0f92d-3961-41ac-af89-920f32eebffe service placement] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:27.564930 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0f92d-3961-41ac-af89-920f32eebffe service placement] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:27.565203 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0f92d-3961-41ac-af89-920f32eebffe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:27.567184 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6ca0f92d-3961-41ac-af89-920f32eebffe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:27.579627 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0f92d-3961-41ac-af89-920f32eebffe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:27.581281 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0f92d-3961-41ac-af89-920f32eebffe service placement] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:27.592010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1459/2899] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:27:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:27:37.587024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=32 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:43.471614 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85580-9cad-4f25-902c-4df48830b664 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:43.472112 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85580-9cad-4f25-902c-4df48830b664 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:43.472222 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85580-9cad-4f25-902c-4df48830b664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:43.490743 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c3d85580-9cad-4f25-902c-4df48830b664 None None] MFA Rules not processed for user `d1dd32e8fdec4ea989cc2e83f18944f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 11 14:27:43.491995 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c3d85580-9cad-4f25-902c-4df48830b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:43.552957 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1441/2900] 10.222.0.66 () {58 vars in 967 bytes} [Mon Jul 11 14:27:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 11 14:27:43.593640 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0f92d-3961-41ac-af89-920f32eebffe service placement] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:43.595116 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-6ca0f92d-3961-41ac-af89-920f32eebffe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:43.664693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0f92d-3961-41ac-af89-920f32eebffe service placement] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:43.670478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0aca9-50b2-4762-9f1b-40c012c0af3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945586c90ac148b8880b9ad6409b02f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:43.671134 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0aca9-50b2-4762-9f1b-40c012c0af3d service swift] REQUEST_METHOD: `GET` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:43.671426 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0aca9-50b2-4762-9f1b-40c012c0af3d service swift] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:43.671716 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0aca9-50b2-4762-9f1b-40c012c0af3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:43.680024 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0aca9-50b2-4762-9f1b-40c012c0af3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:43.681622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0aca9-50b2-4762-9f1b-40c012c0af3d service swift] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:43.689844 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1460/2901] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Jul 11 14:27:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 11 14:27:50.501024 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d85580-9cad-4f25-902c-4df48830b664 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:50.502521 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c3d85580-9cad-4f25-902c-4df48830b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:50.569444 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d85580-9cad-4f25-902c-4df48830b664 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:50.574021 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:50.574969 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.575249 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.575526 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] PATH_INFO: `/v3/users/8423598c60644919af82bd0280c0c734` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.576781 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8423598c60644919af82bd0280c0c734)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:50.578729 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:50.633343 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8423598c60644919af82bd0280c0c734'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:50.633983 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8423598c60644919af82bd0280c0c734'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:50.634651 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8423598c60644919af82bd0280c0c734'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:50.641576 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8423598c60644919af82bd0280c0c734'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:50.657669 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8423598c60644919af82bd0280c0c734'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:50.672856 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1442/2902] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:27:50 2022] DELETE /identity/v3/users/8423598c60644919af82bd0280c0c734 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:50.852955 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0aca9-50b2-4762-9f1b-40c012c0af3d service swift] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:50.864205 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0aca9-50b2-4762-9f1b-40c012c0af3d service swift] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:50.926996 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:50.927902 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:50.928192 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:50.928471 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] PATH_INFO: `/v3/projects/47332445bab940c495cb7c4568c5c315` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:50.929693 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47332445bab940c495cb7c4568c5c315)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:50.931659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:50.977400 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47332445bab940c495cb7c4568c5c315', 'request_id': 'req-15cd5166-4c58-4db2-9080-b93aff9b6d50'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:50.983638 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47332445bab940c495cb7c4568c5c315', 'request_id': 'req-15cd5166-4c58-4db2-9080-b93aff9b6d50'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:50.989478 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47332445bab940c495cb7c4568c5c315', 'request_id': 'req-15cd5166-4c58-4db2-9080-b93aff9b6d50'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.002010 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] The token cache is being invalidate because project 47332445bab940c495cb7c4568c5c315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:27:51.002326 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.002948 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.004485 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1461/2903] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:27:50 2022] DELETE /identity/v3/projects/47332445bab940c495cb7c4568c5c315 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 11 14:27:51.008663 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:51.010650 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:51.024064 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0971b77-968e-4c42-855e-43f07545abdd admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:51.044794 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:51.082764 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:51.083633 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:51.083912 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:51.084192 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] PATH_INFO: `/v3/users/3b7ed2d89d7e4dbb88c89b0a543320b2` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:51.085383 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7ed2d89d7e4dbb88c89b0a543320b2)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:51.087340 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:51.133728 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7ed2d89d7e4dbb88c89b0a543320b2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.134505 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7ed2d89d7e4dbb88c89b0a543320b2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.135076 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7ed2d89d7e4dbb88c89b0a543320b2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.141931 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7ed2d89d7e4dbb88c89b0a543320b2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.154613 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7ed2d89d7e4dbb88c89b0a543320b2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.167896 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1443/2904] 10.222.0.66 () {58 vars in 1223 bytes} [Mon Jul 11 14:27:51 2022] DELETE /identity/v3/users/3b7ed2d89d7e4dbb88c89b0a543320b2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:27:51.356622 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] Authenticating user token {{(pid=80387) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:27:51.358125 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.fernet_utils [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80387) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:27:51.371514 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd5166-4c58-4db2-9080-b93aff9b6d50 admin admin] Validating token access rules against request {{(pid=80387) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:27:51.390531 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:27:51.436314 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '477dddd95e9e4c9dab1e4c703d6c3e08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53f35d51b66c4aec847015cb4a904c77', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80387) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:27:51.437208 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:27:51.437494 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:27:51.437773 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] PATH_INFO: `/v3/projects/46d1f3660aec474382049ec6733339c4` {{(pid=80387) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:27:51.439037 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d1f3660aec474382049ec6733339c4)` {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:27:51.441004 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] RBAC: Authorization granted {{(pid=80387) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:27:51.488055 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d1f3660aec474382049ec6733339c4', 'request_id': 'req-14f9a1f6-abaa-4095-8624-e18b20310610'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.494081 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d1f3660aec474382049ec6733339c4', 'request_id': 'req-14f9a1f6-abaa-4095-8624-e18b20310610'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.500198 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d1f3660aec474382049ec6733339c4', 'request_id': 'req-14f9a1f6-abaa-4095-8624-e18b20310610'} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.513837 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] The token cache is being invalidate because project 46d1f3660aec474382049ec6733339c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80387) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 11 14:27:51.514124 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.514968 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG keystone.notifications [None req-14f9a1f6-abaa-4095-8624-e18b20310610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80387) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 11 14:27:51.516659 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: [pid: 80387|app: 0|req: 1462/2905] 10.222.0.66 () {58 vars in 1232 bytes} [Mon Jul 11 14:27:51 2022] DELETE /identity/v3/projects/46d1f3660aec474382049ec6733339c4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 11 14:28:01.163618 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:28:01.510344 dv-cinder-819149-10-iscsi devstack@keystone.service[80387]: DEBUG dbcounter [-] [80387] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80387) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 11 14:32:34.472739 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 11 14:32:34.474177 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:34.635332 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845a962-f601-448d-b7b4-32c87c05d8f2 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 11 14:32:34.695080 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23f281-b8fb-44e2-b6a7-fb332fa22320 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2949783e08504cfba3dc52dcf8b6a015', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1a77332a2b04ef881cf6e03226618ee', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 11 14:32:34.695751 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f281-b8fb-44e2-b6a7-fb332fa22320 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 11 14:32:34.696041 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f281-b8fb-44e2-b6a7-fb332fa22320 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 11 14:32:34.696326 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f281-b8fb-44e2-b6a7-fb332fa22320 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 11 14:32:34.698208 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-eb23f281-b8fb-44e2-b6a7-fb332fa22320 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 11 14:32:34.710552 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23f281-b8fb-44e2-b6a7-fb332fa22320 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 11 14:32:34.712170 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23f281-b8fb-44e2-b6a7-fb332fa22320 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 11 14:32:34.724384 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1444/2906] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Jul 11 14:32:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 11 14:32:44.719514 dv-cinder-819149-10-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}